2023-04-13 04:55:36,125 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-13 04:55:36,436 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-13 04:55:36,536 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-13 04:55:36,603 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-13 04:55:36,610 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-13 04:55:36,622 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=169, AvailableMemoryMB=1558
2023-04-13 04:55:36,624 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-13 04:55:36,625 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-13 04:55:36,754 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040806913:84 , srv113095247:84 , srv1172787176:84 , srv1182425678:84 , srv1264920383:84 , srv1328845014:84 , srv1340179503:84 , srv1361647280:84 , srv1388292347:84 , srv1394406312:84 , srv139444075:84 , srv1399552894:84 , srv1410641576:84 , srv1417699148:84 , srv1424936203:84 , srv1444210312:84 , srv1472909019:84 , srv1473066900:84 , srv1482005597:84 , srv1482659356:84 , srv1507863999:84 , srv1523259757:84 , srv1600284393:84 , srv1607568380:84 , srv1611607651:84 , srv1643141092:84 , srv166171116:84 , srv1674689894:84 , srv170220582:84 , srv1711612815:84 , srv1720546711:84 , srv1736586412:84 , srv1793341535:84 , srv1801383864:84 , srv182169580:84 , srv182328079:84 , srv1824657268:84 , srv1854916539:84 , srv1861132122:84 , srv1890588776:84 , srv19051673:84 , srv1932316443:84 , srv1949042355:84 , srv1976063416:84 , srv1994739021:84 , srv1997307857:84 , srv2026246876:84 , srv2073243210:84 , srv2081161607:84 , srv2100161242:84 , srv2120421702:84 , srv2124983535:84 , srv235227335:84 , srv245847318:84 , srv249223374:84 , srv261483726:84 , srv273025369:84 , srv28164831:84 , srv292405355:84 , srv296359058:84 , srv29780825:84 , srv302529612:84 , srv318517554:84 , srv33788914:84 , srv338408978:84 , srv338528947:84 , srv340916359:84 , srv348487169:84 , srv377241761:84 , srv415371861:84 , srv450072091:84 , srv483910172:84 , srv484613435:84 , srv572636741:84 , srv573850636:84 , srv57553207:84 , srv577949510:84 , srv59673326:84 , srv612153138:84 , srv620471517:84 , srv724843417:84 , srv737251307:84 , srv748841133:84 , srv752514743:84 , srv765491519:84 , srv783857871:84 , srv794924125:84 , srv796371283:84 , srv82733466:84 , srv85357120:84 , srv885607198:84 , srv897396062:84 , srv913388980:84 , srv916676285:84 , srv958863404:84 , srv963404224:84 , srv966912813:84 , srv972814960:84 , srv976650990:84 , srv1499406196:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-13 04:55:36,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:36,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273025369=57, srv338408978=65, srv1444210312=15, srv1997307857=46, srv245847318=54, srv1523259757=22, srv1399552894=11, srv2124983535=52, srv573850636=75, srv1361647280=7, srv483910172=72, srv1611607651=25, srv1890588776=40, srv33788914=64, srv794924125=87, srv302529612=62, srv166171116=27, srv19051673=41, srv737251307=82, srv916676285=94, srv1736586412=32, srv976650990=99, srv783857871=86, srv966912813=97, srv1499406196=20, srv1394406312=9, srv1264920383=4, srv1949042355=43, srv2073243210=48, srv28164831=58, srv296359058=60, srv318517554=63, srv963404224=96, srv1410641576=12, srv897396062=92, srv724843417=81, srv249223374=55, srv972814960=98, srv1607568380=24, srv1172787176=2, srv348487169=68, srv577949510=77, srv1720546711=31, srv1824657268=37, srv612153138=79, srv1793341535=33, srv2026246876=47, srv170220582=29, srv1801383864=34, srv338528947=66, srv415371861=70, srv913388980=93, srv484613435=73, srv113095247=1, srv1417699148=13, srv261483726=56, srv1040806913=0, srv1388292347=8, srv1711612815=30, srv2100161242=50, srv1340179503=6, srv377241761=69, srv59673326=78, srv765491519=85, srv1482005597=18, srv1473066900=17, srv2081161607=49, srv139444075=10, srv796371283=88, srv1424936203=14, srv1600284393=23, srv1472909019=16, srv1643141092=26, srv620471517=80, srv1861132122=39, srv340916359=67, srv1182425678=3, srv1932316443=42, srv1507863999=21, srv182169580=35, srv1976063416=44, srv2120421702=51, srv885607198=91, srv82733466=89, srv57553207=76, srv85357120=90, srv292405355=59, srv752514743=84, srv1854916539=38, srv450072091=71, srv29780825=61, srv1674689894=28, srv748841133=83, srv1994739021=45, srv235227335=53, srv1482659356=19, srv1328845014=5, srv572636741=74, srv182328079=36, srv958863404=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:36,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:36,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:36,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-13 04:55:36,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-13 04:55:36,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-13 04:55:36,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-13 04:55:36,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-13 04:55:36,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-13 04:55:36,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-13 04:55:36,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-13 04:55:37,094 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:37,095 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-13 04:55:37,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-13 04:55:37,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 865 ms to try 5000 different iterations.  Found a solution that moves 4716 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17561768572682057. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0406070656692541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0567191280233234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.524, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0406070656692541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:37,763 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1861132122:82 , srv572636741:82 , srv573850636:82 , srv916676285:82 , srv113095247:83 , srv1607568380:83 , srv1854916539:83 , srv1994739021:83 , srv235227335:83 , srv29780825:83 , srv966912813:83 , srv1172787176:84 , srv1417699148:84 , srv1824657268:84 , srv273025369:84 , srv338408978:84 , srv483910172:84 , srv577949510:84 , srv620471517:84 , srv1473066900:85 , srv1482005597:85 , srv1507863999:85 , srv1611607651:85 , srv1736586412:85 , srv1793341535:85 , srv19051673:85 , srv1932316443:85 , srv2120421702:85 , srv59673326:85 , srv612153138:85 , srv737251307:85 , srv748841133:85 , srv794924125:85 , srv796371283:85 , srv897396062:85 , srv1040806913:86 , srv1264920383:86 , srv1328845014:86 , srv1361647280:86 , srv1394406312:86 , srv1399552894:86 , srv1410641576:86 , srv1424936203:86 , srv1472909019:86 , srv1523259757:86 , srv1801383864:86 , srv182169580:86 , srv182328079:86 , srv2081161607:86 , srv245847318:86 , srv292405355:86 , srv302529612:86 , srv318517554:86 , srv415371861:86 , srv450072091:86 , srv724843417:86 , srv85357120:86 , srv1340179503:87 , srv1444210312:87 , srv1482659356:87 , srv166171116:87 , srv1711612815:87 , srv1949042355:87 , srv2073243210:87 , srv2100161242:87 , srv28164831:87 , srv338528947:87 , srv340916359:87 , srv377241761:87 , srv57553207:87 , srv752514743:87 , srv765491519:87 , srv885607198:87 , srv1182425678:88 , srv1388292347:88 , srv139444075:88 , srv1674689894:88 , srv170220582:88 , srv1976063416:88 , srv249223374:88 , srv261483726:88 , srv33788914:88 , srv484613435:88 , srv783857871:88 , srv972814960:88 , srv1600284393:89 , srv1890588776:89 , srv2026246876:89 , srv348487169:89 , srv82733466:89 , srv963404224:89 , srv976650990:90 , srv1643141092:91 , srv1720546711:91 , srv1997307857:91 , srv2124983535:91 , srv296359058:91 , srv958863404:91 , srv913388980:98 , srv1499406196:451 }
2023-04-13 04:55:37,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:37,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273025369=57, srv338408978=65, srv1444210312=15, srv1997307857=46, srv245847318=54, srv1523259757=22, srv1399552894=11, srv2124983535=52, srv573850636=75, srv1361647280=7, srv483910172=72, srv1611607651=25, srv1890588776=40, srv33788914=64, srv794924125=87, srv302529612=62, srv166171116=27, srv19051673=41, srv737251307=82, srv916676285=94, srv1736586412=32, srv976650990=99, srv783857871=86, srv966912813=97, srv1499406196=20, srv1394406312=9, srv1264920383=4, srv1949042355=43, srv2073243210=48, srv28164831=58, srv296359058=60, srv318517554=63, srv963404224=96, srv1410641576=12, srv897396062=92, srv724843417=81, srv249223374=55, srv972814960=98, srv1607568380=24, srv1172787176=2, srv348487169=68, srv577949510=77, srv1720546711=31, srv1824657268=37, srv612153138=79, srv1793341535=33, srv2026246876=47, srv170220582=29, srv1801383864=34, srv338528947=66, srv415371861=70, srv913388980=93, srv484613435=73, srv113095247=1, srv1417699148=13, srv261483726=56, srv1040806913=0, srv1388292347=8, srv1711612815=30, srv2100161242=50, srv1340179503=6, srv377241761=69, srv59673326=78, srv765491519=85, srv1482005597=18, srv1473066900=17, srv2081161607=49, srv139444075=10, srv796371283=88, srv1424936203=14, srv1600284393=23, srv1472909019=16, srv1643141092=26, srv620471517=80, srv1861132122=39, srv340916359=67, srv1182425678=3, srv1932316443=42, srv1507863999=21, srv182169580=35, srv1976063416=44, srv2120421702=51, srv885607198=91, srv82733466=89, srv57553207=76, srv85357120=90, srv292405355=59, srv752514743=84, srv1854916539=38, srv450072091=71, srv29780825=61, srv1674689894=28, srv748841133=83, srv1994739021=45, srv235227335=53, srv1482659356=19, srv1328845014=5, srv572636741=74, srv182328079=36, srv958863404=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:37,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:37,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:37,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:37,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:37,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-13 04:55:37,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-13 04:55:37,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-13 04:55:37,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-13 04:55:37,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-13 04:55:37,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-13 04:55:37,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-13 04:55:37,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-13 04:55:37,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-13 04:55:37,991 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0406070656692541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0567191280233234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0406070656692541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:37,991 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-13 04:55:37,992 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17558466358902428, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0406070656692541, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0567191280233234, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0406070656692541, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17041666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24116666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-13 04:55:38,277 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 448 ms to try 5000 different iterations.  Found a solution that moves 2690 regions; Going from a computed imbalance of 0.17558466358902428 to a new imbalance of 0.014428881720770469. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019949431018948832); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03657012082798931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29888888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019949431018948832); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:38,285 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv913388980:73 , srv1997307857:80 , srv2124983535:80 , srv296359058:81 , srv82733466:81 , srv765491519:82 , srv783857871:82 , srv958863404:82 , srv1182425678:83 , srv1328845014:83 , srv1394406312:83 , srv139444075:83 , srv1643141092:83 , srv170220582:83 , srv2026246876:83 , srv2100161242:83 , srv348487169:83 , srv752514743:83 , srv972814960:83 , srv976650990:83 , srv1340179503:84 , srv1600284393:84 , srv1674689894:84 , srv1890588776:84 , srv1976063416:84 , srv340916359:84 , srv885607198:84 , srv1040806913:85 , srv1388292347:85 , srv1399552894:85 , srv1482659356:85 , srv166171116:85 , srv1711612815:85 , srv249223374:85 , srv261483726:85 , srv318517554:85 , srv33788914:85 , srv415371861:85 , srv748841133:85 , srv1172787176:86 , srv1264920383:86 , srv1410641576:86 , srv1417699148:86 , srv1424936203:86 , srv1444210312:86 , srv1473066900:86 , srv1482005597:86 , srv1507863999:86 , srv1720546711:86 , srv182169580:86 , srv2073243210:86 , srv2120421702:86 , srv245847318:86 , srv292405355:86 , srv377241761:86 , srv484613435:86 , srv724843417:86 , srv1361647280:87 , srv1472909019:87 , srv1611607651:87 , srv1801383864:87 , srv182328079:87 , srv19051673:87 , srv1932316443:87 , srv2081161607:87 , srv273025369:87 , srv302529612:87 , srv338528947:87 , srv577949510:87 , srv612153138:87 , srv620471517:87 , srv737251307:87 , srv796371283:87 , srv897396062:87 , srv963404224:87 , srv1793341535:88 , srv1824657268:88 , srv235227335:88 , srv28164831:88 , srv29780825:88 , srv450072091:88 , srv59673326:88 , srv794924125:88 , srv85357120:88 , srv966912813:88 , srv113095247:89 , srv1523259757:89 , srv1736586412:89 , srv1854916539:89 , srv1861132122:89 , srv1994739021:89 , srv57553207:89 , srv1949042355:90 , srv338408978:90 , srv483910172:90 , srv572636741:90 , srv916676285:91 , srv573850636:92 , srv1607568380:95 , srv1499406196:500 }
2023-04-13 04:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273025369=57, srv338408978=65, srv1444210312=15, srv1997307857=46, srv245847318=54, srv1523259757=22, srv1399552894=11, srv2124983535=52, srv573850636=75, srv1361647280=7, srv483910172=72, srv1611607651=25, srv1890588776=40, srv33788914=64, srv794924125=87, srv302529612=62, srv166171116=27, srv19051673=41, srv737251307=82, srv916676285=94, srv1736586412=32, srv976650990=99, srv783857871=86, srv966912813=97, srv1499406196=20, srv1394406312=9, srv1264920383=4, srv1949042355=43, srv2073243210=48, srv28164831=58, srv296359058=60, srv318517554=63, srv963404224=96, srv1410641576=12, srv897396062=92, srv724843417=81, srv249223374=55, srv972814960=98, srv1607568380=24, srv1172787176=2, srv348487169=68, srv577949510=77, srv1720546711=31, srv1824657268=37, srv612153138=79, srv1793341535=33, srv2026246876=47, srv170220582=29, srv1801383864=34, srv338528947=66, srv415371861=70, srv913388980=93, srv484613435=73, srv113095247=1, srv1417699148=13, srv261483726=56, srv1040806913=0, srv1388292347=8, srv1711612815=30, srv2100161242=50, srv1340179503=6, srv377241761=69, srv59673326=78, srv765491519=85, srv1482005597=18, srv1473066900=17, srv2081161607=49, srv139444075=10, srv796371283=88, srv1424936203=14, srv1600284393=23, srv1472909019=16, srv1643141092=26, srv620471517=80, srv1861132122=39, srv340916359=67, srv1182425678=3, srv1932316443=42, srv1507863999=21, srv182169580=35, srv1976063416=44, srv2120421702=51, srv885607198=91, srv82733466=89, srv57553207=76, srv85357120=90, srv292405355=59, srv752514743=84, srv1854916539=38, srv450072091=71, srv29780825=61, srv1674689894=28, srv748841133=83, srv1994739021=45, srv235227335=53, srv1482659356=19, srv1328845014=5, srv572636741=74, srv182328079=36, srv958863404=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:38,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:38,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-13 04:55:38,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-13 04:55:38,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-13 04:55:38,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-13 04:55:38,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-13 04:55:38,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-13 04:55:38,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019949431018948832); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03657012082798931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019949431018948832); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:38,423 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-13 04:55:38,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014410045938185215, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019949431018948832); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03657012082798931, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019949431018948832); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04716666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-13 04:55:38,680 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 1000 regions; Going from a computed imbalance of 0.014410045938185215 to a new imbalance of 8.039863981283693E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008151208485588693); MoveCostFunction : (multiplier=7.0, imbalance=0.1111111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:38,682 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1607568380:80 , srv1720546711:81 , srv1949042355:81 , srv963404224:81 , srv1523259757:82 , srv28164831:82 , srv57553207:82 , srv1643141092:83 , srv1736586412:83 , srv483910172:83 , srv1388292347:84 , srv1472909019:84 , srv1801383864:84 , srv182328079:84 , srv261483726:84 , srv33788914:84 , srv338408978:84 , srv338528947:84 , srv450072091:84 , srv484613435:84 , srv573850636:84 , srv59673326:84 , srv85357120:84 , srv958863404:84 , srv976650990:84 , srv1361647280:85 , srv1444210312:85 , srv1482659356:85 , srv1600284393:85 , srv166171116:85 , srv1711612815:85 , srv1793341535:85 , srv1890588776:85 , srv19051673:85 , srv1976063416:85 , srv1994739021:85 , srv2073243210:85 , srv2081161607:85 , srv245847318:85 , srv249223374:85 , srv302529612:85 , srv348487169:85 , srv572636741:85 , srv612153138:85 , srv794924125:85 , srv796371283:85 , srv897396062:85 , srv916676285:85 , srv1040806913:86 , srv113095247:86 , srv1182425678:86 , srv1264920383:86 , srv1340179503:86 , srv139444075:86 , srv1410641576:86 , srv1424936203:86 , srv1507863999:86 , srv1611607651:86 , srv1674689894:86 , srv182169580:86 , srv1854916539:86 , srv1861132122:86 , srv1932316443:86 , srv1997307857:86 , srv2026246876:86 , srv2120421702:86 , srv2124983535:86 , srv235227335:86 , srv273025369:86 , srv292405355:86 , srv296359058:86 , srv29780825:86 , srv318517554:86 , srv377241761:86 , srv577949510:86 , srv620471517:86 , srv737251307:86 , srv913388980:86 , srv966912813:86 , srv972814960:86 , srv1394406312:87 , srv1399552894:87 , srv1473066900:87 , srv1482005597:87 , srv170220582:87 , srv1824657268:87 , srv2100161242:87 , srv340916359:87 , srv415371861:87 , srv724843417:87 , srv783857871:87 , srv885607198:87 , srv1172787176:88 , srv1328845014:88 , srv1417699148:88 , srv748841133:88 , srv752514743:88 , srv82733466:88 , srv765491519:90 , srv1499406196:553 }
2023-04-13 04:55:38,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:38,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273025369=57, srv338408978=65, srv1444210312=15, srv1997307857=46, srv245847318=54, srv1523259757=22, srv1399552894=11, srv2124983535=52, srv573850636=75, srv1361647280=7, srv483910172=72, srv1611607651=25, srv1890588776=40, srv33788914=64, srv794924125=87, srv302529612=62, srv166171116=27, srv19051673=41, srv737251307=82, srv916676285=94, srv1736586412=32, srv976650990=99, srv783857871=86, srv966912813=97, srv1499406196=20, srv1394406312=9, srv1264920383=4, srv1949042355=43, srv2073243210=48, srv28164831=58, srv296359058=60, srv318517554=63, srv963404224=96, srv1410641576=12, srv897396062=92, srv724843417=81, srv249223374=55, srv972814960=98, srv1607568380=24, srv1172787176=2, srv348487169=68, srv577949510=77, srv1720546711=31, srv1824657268=37, srv612153138=79, srv1793341535=33, srv2026246876=47, srv170220582=29, srv1801383864=34, srv338528947=66, srv415371861=70, srv913388980=93, srv484613435=73, srv113095247=1, srv1417699148=13, srv261483726=56, srv1040806913=0, srv1388292347=8, srv1711612815=30, srv2100161242=50, srv1340179503=6, srv377241761=69, srv59673326=78, srv765491519=85, srv1482005597=18, srv1473066900=17, srv2081161607=49, srv139444075=10, srv796371283=88, srv1424936203=14, srv1600284393=23, srv1472909019=16, srv1643141092=26, srv620471517=80, srv1861132122=39, srv340916359=67, srv1182425678=3, srv1932316443=42, srv1507863999=21, srv182169580=35, srv1976063416=44, srv2120421702=51, srv885607198=91, srv82733466=89, srv57553207=76, srv85357120=90, srv292405355=59, srv752514743=84, srv1854916539=38, srv450072091=71, srv29780825=61, srv1674689894=28, srv748841133=83, srv1994739021=45, srv235227335=53, srv1482659356=19, srv1328845014=5, srv572636741=74, srv182328079=36, srv958863404=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:38,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:38,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:38,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:38,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-13 04:55:38,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-13 04:55:38,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-13 04:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-13 04:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-13 04:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-13 04:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-13 04:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-13 04:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-13 04:55:38,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008151208485588693); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:38,881 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-13 04:55:38,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.969842484684237E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008151208485588693); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-13 04:55:39,215 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 473 ms to try 5000 different iterations.  Found a solution that moves 256 regions; Going from a computed imbalance of 7.969842484684237E-4 to a new imbalance of 1.941782042804508E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.028444444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:39,216 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1361647280:83 , srv1607568380:83 , srv1824657268:83 , srv377241761:83 , srv450072091:83 , srv724843417:83 , srv765491519:83 , srv1040806913:84 , srv113095247:84 , srv1172787176:84 , srv1264920383:84 , srv1399552894:84 , srv1410641576:84 , srv1417699148:84 , srv1424936203:84 , srv1444210312:84 , srv1473066900:84 , srv1482005597:84 , srv1611607651:84 , srv1674689894:84 , srv1720546711:84 , srv1793341535:84 , srv1801383864:84 , srv182169580:84 , srv1854916539:84 , srv1890588776:84 , srv1932316443:84 , srv1949042355:84 , srv2026246876:84 , srv2073243210:84 , srv2081161607:84 , srv249223374:84 , srv296359058:84 , srv338408978:84 , srv338528947:84 , srv340916359:84 , srv415371861:84 , srv484613435:84 , srv573850636:84 , srv57553207:84 , srv737251307:84 , srv748841133:84 , srv752514743:84 , srv794924125:84 , srv82733466:84 , srv85357120:84 , srv885607198:84 , srv916676285:84 , srv1182425678:85 , srv1328845014:85 , srv1340179503:85 , srv1388292347:85 , srv139444075:85 , srv1472909019:85 , srv1482659356:85 , srv1507863999:85 , srv1523259757:85 , srv1600284393:85 , srv1643141092:85 , srv166171116:85 , srv170220582:85 , srv1711612815:85 , srv1736586412:85 , srv182328079:85 , srv1861132122:85 , srv19051673:85 , srv1976063416:85 , srv1994739021:85 , srv1997307857:85 , srv2100161242:85 , srv2120421702:85 , srv2124983535:85 , srv245847318:85 , srv261483726:85 , srv28164831:85 , srv292405355:85 , srv29780825:85 , srv302529612:85 , srv318517554:85 , srv33788914:85 , srv348487169:85 , srv483910172:85 , srv572636741:85 , srv577949510:85 , srv59673326:85 , srv612153138:85 , srv620471517:85 , srv783857871:85 , srv796371283:85 , srv897396062:85 , srv913388980:85 , srv958863404:85 , srv963404224:85 , srv966912813:85 , srv972814960:85 , srv976650990:85 , srv1394406312:86 , srv235227335:86 , srv273025369:86 , srv1499406196:637 }
2023-04-13 04:55:39,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:39,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv273025369=57, srv338408978=65, srv1444210312=15, srv1997307857=46, srv245847318=54, srv1523259757=22, srv1399552894=11, srv2124983535=52, srv573850636=75, srv1361647280=7, srv483910172=72, srv1611607651=25, srv1890588776=40, srv33788914=64, srv794924125=87, srv302529612=62, srv166171116=27, srv19051673=41, srv737251307=82, srv916676285=94, srv1736586412=32, srv976650990=99, srv783857871=86, srv966912813=97, srv1499406196=20, srv1394406312=9, srv1264920383=4, srv1949042355=43, srv2073243210=48, srv28164831=58, srv296359058=60, srv318517554=63, srv963404224=96, srv1410641576=12, srv897396062=92, srv724843417=81, srv249223374=55, srv972814960=98, srv1607568380=24, srv1172787176=2, srv348487169=68, srv577949510=77, srv1720546711=31, srv1824657268=37, srv612153138=79, srv1793341535=33, srv2026246876=47, srv170220582=29, srv1801383864=34, srv338528947=66, srv415371861=70, srv913388980=93, srv484613435=73, srv113095247=1, srv1417699148=13, srv261483726=56, srv1040806913=0, srv1388292347=8, srv1711612815=30, srv2100161242=50, srv1340179503=6, srv377241761=69, srv59673326=78, srv765491519=85, srv1482005597=18, srv1473066900=17, srv2081161607=49, srv139444075=10, srv796371283=88, srv1424936203=14, srv1600284393=23, srv1472909019=16, srv1643141092=26, srv620471517=80, srv1861132122=39, srv340916359=67, srv1182425678=3, srv1932316443=42, srv1507863999=21, srv182169580=35, srv1976063416=44, srv2120421702=51, srv885607198=91, srv82733466=89, srv57553207=76, srv85357120=90, srv292405355=59, srv752514743=84, srv1854916539=38, srv450072091=71, srv29780825=61, srv1674689894=28, srv748841133=83, srv1994739021=45, srv235227335=53, srv1482659356=19, srv1328845014=5, srv572636741=74, srv182328079=36, srv958863404=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:39,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:39,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:39,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-13 04:55:39,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-13 04:55:39,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-13 04:55:39,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-13 04:55:39,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-13 04:55:39,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-13 04:55:39,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-13 04:55:39,384 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7625270115099008E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:39,385 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1361647280:83 , srv1607568380:83 , srv1824657268:83 , srv377241761:83 , srv450072091:83 , srv724843417:83 , srv765491519:83 , srv1040806913:84 , srv113095247:84 , srv1172787176:84 , srv1264920383:84 , srv1399552894:84 , srv1410641576:84 , srv1417699148:84 , srv1424936203:84 , srv1444210312:84 , srv1473066900:84 , srv1482005597:84 , srv1611607651:84 , srv1674689894:84 , srv1720546711:84 , srv1793341535:84 , srv1801383864:84 , srv182169580:84 , srv1854916539:84 , srv1890588776:84 , srv1932316443:84 , srv1949042355:84 , srv2026246876:84 , srv2073243210:84 , srv2081161607:84 , srv249223374:84 , srv296359058:84 , srv338408978:84 , srv338528947:84 , srv340916359:84 , srv415371861:84 , srv484613435:84 , srv573850636:84 , srv57553207:84 , srv737251307:84 , srv748841133:84 , srv752514743:84 , srv794924125:84 , srv82733466:84 , srv85357120:84 , srv885607198:84 , srv916676285:84 , srv1182425678:85 , srv1328845014:85 , srv1340179503:85 , srv1388292347:85 , srv139444075:85 , srv1472909019:85 , srv1482659356:85 , srv1507863999:85 , srv1523259757:85 , srv1600284393:85 , srv1643141092:85 , srv166171116:85 , srv170220582:85 , srv1711612815:85 , srv1736586412:85 , srv182328079:85 , srv1861132122:85 , srv19051673:85 , srv1976063416:85 , srv1994739021:85 , srv1997307857:85 , srv2100161242:85 , srv2120421702:85 , srv2124983535:85 , srv245847318:85 , srv261483726:85 , srv28164831:85 , srv292405355:85 , srv29780825:85 , srv302529612:85 , srv318517554:85 , srv33788914:85 , srv348487169:85 , srv483910172:85 , srv572636741:85 , srv577949510:85 , srv59673326:85 , srv612153138:85 , srv620471517:85 , srv783857871:85 , srv796371283:85 , srv897396062:85 , srv913388980:85 , srv958863404:85 , srv963404224:85 , srv966912813:85 , srv972814960:85 , srv976650990:85 , srv1394406312:86 , srv235227335:86 , srv273025369:86 , srv1499406196:637 }
2023-04-13 04:55:39,424 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=383 (was 382) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1061 (was 1558)
2023-04-13 04:55:39,447 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=383, ProcessCount=169, AvailableMemoryMB=1061
2023-04-13 04:55:39,447 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-13 04:55:39,449 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-13 04:55:39,468 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1068272886:84 , srv10866000:84 , srv1185324575:84 , srv1192798420:84 , srv1270662778:84 , srv1443923586:84 , srv1535748701:84 , srv1572692753:84 , srv1604990905:84 , srv1671153190:84 , srv1883187822:84 , srv1903184932:84 , srv1920751978:84 , srv1928601321:84 , srv1973078256:84 , srv202411912:84 , srv207014738:84 , srv209020626:84 , srv20984655:84 , srv295496739:84 , srv424809258:84 , srv47322951:84 , srv689668181:84 , srv711447522:84 , srv725692450:84 , srv757540329:84 , srv837673722:84 , srv846527762:84 , srv94695104:84 , srv1190364096:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-13 04:55:39,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:55:39,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv295496739=20, srv1185324575=2, srv1270662778=5, srv757540329=26, srv1572692753=8, srv846527762=28, srv711447522=24, srv1604990905=9, srv1190364096=3, srv1443923586=6, srv424809258=21, srv1903184932=12, srv837673722=27, srv20984655=19, srv1928601321=14, srv1973078256=15, srv209020626=18, srv1535748701=7, srv1920751978=13, srv10866000=1, srv1192798420=4, srv202411912=16, srv94695104=29, srv1068272886=0, srv47322951=22, srv207014738=17, srv1883187822=11, srv725692450=25, srv1671153190=10, srv689668181=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:55:39,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:55:39,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:55:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:55:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:55:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:55:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:55:39,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:55:39,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:55:39,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:55:39,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:55:39,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:55:39,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-13 04:55:39,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1242348158885591, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:55:39,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912584503112505, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1242348158885591, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-13 04:57:39,496 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6183833 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.9912584503112505 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:57:39,502 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1068272886:90 , srv10866000:90 , srv1185324575:90 , srv1190364096:90 , srv1192798420:90 , srv1270662778:90 , srv1443923586:90 , srv1535748701:90 , srv1572692753:90 , srv1604990905:90 , srv1671153190:90 , srv1883187822:90 , srv1903184932:90 , srv1920751978:90 , srv1928601321:90 , srv1973078256:90 , srv202411912:90 , srv207014738:90 , srv209020626:90 , srv20984655:90 , srv295496739:90 , srv424809258:90 , srv47322951:90 , srv689668181:90 , srv711447522:90 , srv725692450:90 , srv757540329:90 , srv837673722:90 , srv846527762:90 , srv94695104:90 }
2023-04-13 04:57:39,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-13 04:57:39,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv295496739=20, srv1185324575=2, srv1270662778=5, srv757540329=26, srv1572692753=8, srv846527762=28, srv711447522=24, srv1604990905=9, srv1190364096=3, srv1443923586=6, srv424809258=21, srv1903184932=12, srv837673722=27, srv20984655=19, srv1928601321=14, srv1973078256=15, srv209020626=18, srv1535748701=7, srv1920751978=13, srv10866000=1, srv1192798420=4, srv202411912=16, srv94695104=29, srv1068272886=0, srv47322951=22, srv207014738=17, srv1883187822=11, srv725692450=25, srv1671153190=10, srv689668181=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-13 04:57:39,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-13 04:57:39,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-13 04:57:39,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-13 04:57:39,519 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-13 04:57:39,519 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1068272886:90 , srv10866000:90 , srv1185324575:90 , srv1190364096:90 , srv1192798420:90 , srv1270662778:90 , srv1443923586:90 , srv1535748701:90 , srv1572692753:90 , srv1604990905:90 , srv1671153190:90 , srv1883187822:90 , srv1903184932:90 , srv1920751978:90 , srv1928601321:90 , srv1973078256:90 , srv202411912:90 , srv207014738:90 , srv209020626:90 , srv20984655:90 , srv295496739:90 , srv424809258:90 , srv47322951:90 , srv689668181:90 , srv711447522:90 , srv725692450:90 , srv757540329:90 , srv837673722:90 , srv846527762:90 , srv94695104:90 }
2023-04-13 04:57:39,532 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 383), ProcessCount=169 (was 169), AvailableMemoryMB=1084 (was 1061) - AvailableMemoryMB LEAK? -