2023-08-08 16:53:10,008 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-08 16:53:10,336 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-08 16:53:10,455 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-08 16:53:10,531 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-08 16:53:10,540 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-08 16:53:10,553 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=173, AvailableMemoryMB=2993
2023-08-08 16:53:10,555 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-08 16:53:10,555 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-08 16:53:10,706 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011160570:84 , srv1035691963:84 , srv1071255983:84 , srv1081845780:84 , srv1104698755:84 , srv1162693167:84 , srv1163559274:84 , srv1207824822:84 , srv1239046614:84 , srv12397647:84 , srv1296947294:84 , srv1324918650:84 , srv1350656743:84 , srv1379285469:84 , srv1431672165:84 , srv1437215099:84 , srv1491132875:84 , srv1498147604:84 , srv1539322931:84 , srv1550613211:84 , srv156528691:84 , srv1565440948:84 , srv1585023840:84 , srv1598160066:84 , srv1630446218:84 , srv1636404759:84 , srv1663437871:84 , srv1664220168:84 , srv1677489219:84 , srv1685142782:84 , srv1692092290:84 , srv1730892444:84 , srv1731209544:84 , srv1748329055:84 , srv1750808685:84 , srv1758034891:84 , srv1805762737:84 , srv1815857513:84 , srv1820061448:84 , srv18260927:84 , srv1889424613:84 , srv1895045783:84 , srv1903850715:84 , srv1921057119:84 , srv1930166335:84 , srv1980313453:84 , srv2022364526:84 , srv2027554757:84 , srv2052554191:84 , srv2054205226:84 , srv2088234168:84 , srv2131424887:84 , srv259272077:84 , srv260206682:84 , srv266591109:84 , srv287113484:84 , srv292975113:84 , srv304176271:84 , srv328694533:84 , srv333707459:84 , srv346380697:84 , srv387287567:84 , srv393640126:84 , srv415209564:84 , srv416085300:84 , srv419226487:84 , srv421290187:84 , srv431367604:84 , srv452047609:84 , srv481909061:84 , srv499735613:84 , srv513902751:84 , srv519628472:84 , srv535790806:84 , srv536639698:84 , srv555399877:84 , srv580973575:84 , srv583353648:84 , srv584266414:84 , srv592622451:84 , srv603861991:84 , srv625757727:84 , srv650612961:84 , srv655540398:84 , srv663583090:84 , srv689246379:84 , srv695341497:84 , srv73171138:84 , srv737702651:84 , srv759457950:84 , srv801326526:84 , srv807380582:84 , srv848868952:84 , srv873231842:84 , srv888204036:84 , srv895512727:84 , srv902810798:84 , srv989796465:84 , srv998400482:84 , srv555216583:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-08 16:53:10,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:10,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:10,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:10,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:10,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:10,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:10,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:10,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:10,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:10,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:10,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:10,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:10,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:10,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:10,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:10,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:10,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:10,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:10,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:10,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:10,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:10,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:10,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:10,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:10,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:10,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:10,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:11,089 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:11,090 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-08 16:53:11,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-08 16:53:11,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 701 ms to try 5000 different iterations.  Found a solution that moves 4726 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18092078157045943. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03594032825964308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05480093554380134, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5251111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03594032825964308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:11,573 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2054205226:81 , srv1903850715:82 , srv1980313453:82 , srv689246379:82 , srv1162693167:83 , srv1163559274:83 , srv1550613211:83 , srv1750808685:83 , srv1930166335:83 , srv513902751:83 , srv555399877:83 , srv583353648:83 , srv655540398:83 , srv12397647:84 , srv1431672165:84 , srv1539322931:84 , srv1565440948:84 , srv1598160066:84 , srv1815857513:84 , srv1889424613:84 , srv2052554191:84 , srv259272077:84 , srv592622451:84 , srv801326526:84 , srv1630446218:85 , srv1664220168:85 , srv1692092290:85 , srv292975113:85 , srv328694533:85 , srv333707459:85 , srv535790806:85 , srv536639698:85 , srv663583090:85 , srv1239046614:86 , srv1296947294:86 , srv1663437871:86 , srv1685142782:86 , srv1731209544:86 , srv1820061448:86 , srv18260927:86 , srv1895045783:86 , srv1921057119:86 , srv260206682:86 , srv287113484:86 , srv416085300:86 , srv419226487:86 , srv452047609:86 , srv1035691963:87 , srv1081845780:87 , srv1104698755:87 , srv1350656743:87 , srv1491132875:87 , srv156528691:87 , srv2088234168:87 , srv266591109:87 , srv393640126:87 , srv580973575:87 , srv73171138:87 , srv759457950:87 , srv848868952:87 , srv895512727:87 , srv902810798:87 , srv1071255983:88 , srv1437215099:88 , srv1585023840:88 , srv1730892444:88 , srv2027554757:88 , srv519628472:88 , srv650612961:88 , srv737702651:88 , srv888204036:88 , srv989796465:88 , srv1011160570:89 , srv1207824822:89 , srv1498147604:89 , srv1677489219:89 , srv304176271:89 , srv387287567:89 , srv421290187:89 , srv481909061:89 , srv499735613:89 , srv603861991:89 , srv625757727:89 , srv695341497:89 , srv1748329055:90 , srv2131424887:90 , srv431367604:90 , srv584266414:90 , srv873231842:90 , srv1379285469:91 , srv1636404759:91 , srv1805762737:91 , srv346380697:91 , srv998400482:91 , srv1758034891:92 , srv2022364526:92 , srv807380582:92 , srv415209564:93 , srv1324918650:97 , srv555216583:409 }
2023-08-08 16:53:11,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:11,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:11,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:11,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:11,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:11,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:11,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:11,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:11,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:11,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:11,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:11,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:11,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:11,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:11,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03594032825964308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05480093554380134, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03594032825964308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:11,819 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-08 16:53:11,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18088768941116654, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03594032825964308, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05480093554380134, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03594032825964308, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17591666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-08 16:53:12,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 740 ms to try 5000 different iterations.  Found a solution that moves 2654 regions; Going from a computed imbalance of 0.18088768941116654 to a new imbalance of 0.014127833601020948. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021495989527846104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03642559256196747, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29488888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021495989527846104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:12,418 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1324918650:74 , srv1758034891:77 , srv415209564:79 , srv998400482:79 , srv2022364526:80 , srv421290187:81 , srv519628472:81 , srv625757727:81 , srv807380582:81 , srv873231842:81 , srv1379285469:82 , srv1498147604:82 , srv1636404759:82 , srv346380697:82 , srv481909061:82 , srv499735613:82 , srv1035691963:83 , srv1071255983:83 , srv1104698755:83 , srv1207824822:83 , srv1585023840:83 , srv1677489219:83 , srv2027554757:83 , srv2131424887:83 , srv584266414:83 , srv603861991:83 , srv1011160570:84 , srv1239046614:84 , srv1350656743:84 , srv1437215099:84 , srv1730892444:84 , srv2088234168:84 , srv304176271:84 , srv387287567:84 , srv431367604:84 , srv695341497:84 , srv737702651:84 , srv888204036:84 , srv895512727:84 , srv1565440948:85 , srv1664220168:85 , srv1748329055:85 , srv1805762737:85 , srv1895045783:85 , srv1921057119:85 , srv260206682:85 , srv287113484:85 , srv419226487:85 , srv536639698:85 , srv73171138:85 , srv902810798:85 , srv989796465:85 , srv1081845780:86 , srv156528691:86 , srv1731209544:86 , srv1820061448:86 , srv18260927:86 , srv266591109:86 , srv328694533:86 , srv333707459:86 , srv416085300:86 , srv452047609:86 , srv580973575:86 , srv650612961:86 , srv663583090:86 , srv759457950:86 , srv1296947294:87 , srv1491132875:87 , srv1550613211:87 , srv1663437871:87 , srv1685142782:87 , srv1692092290:87 , srv1930166335:87 , srv393640126:87 , srv535790806:87 , srv1889424613:88 , srv1903850715:88 , srv292975113:88 , srv689246379:88 , srv848868952:88 , srv1163559274:89 , srv12397647:89 , srv1431672165:89 , srv1630446218:89 , srv1980313453:89 , srv2052554191:89 , srv259272077:89 , srv513902751:89 , srv592622451:89 , srv801326526:89 , srv1162693167:90 , srv1539322931:90 , srv1598160066:90 , srv1750808685:90 , srv583353648:90 , srv655540398:90 , srv1815857513:91 , srv2054205226:91 , srv555399877:92 , srv555216583:556 }
2023-08-08 16:53:12,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:12,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:12,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:12,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:12,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:12,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:12,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:12,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:12,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:12,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:12,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:12,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:12,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:12,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:12,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:12,712 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021495989527846104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03642559256196747, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021495989527846104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:12,712 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-08 16:53:12,712 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014109249895823451, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021495989527846104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03642559256196747, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021495989527846104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-08 16:53:13,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 483 ms to try 5000 different iterations.  Found a solution that moves 985 regions; Going from a computed imbalance of 0.014109249895823451 to a new imbalance of 8.54978545213363E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005457038961169203); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.10944444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005457038961169203); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:13,010 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1805762737:81 , srv555399877:82 , srv1491132875:83 , srv1598160066:83 , srv1630446218:83 , srv1748329055:83 , srv416085300:83 , srv848868952:83 , srv1081845780:84 , srv12397647:84 , srv1431672165:84 , srv1539322931:84 , srv156528691:84 , srv1663437871:84 , srv1750808685:84 , srv1815857513:84 , srv2131424887:84 , srv292975113:84 , srv304176271:84 , srv431367604:84 , srv452047609:84 , srv513902751:84 , srv650612961:84 , srv759457950:84 , srv807380582:84 , srv1162693167:85 , srv1207824822:85 , srv1296947294:85 , srv1379285469:85 , srv1636404759:85 , srv1677489219:85 , srv1685142782:85 , srv1730892444:85 , srv1731209544:85 , srv1889424613:85 , srv1921057119:85 , srv2022364526:85 , srv2052554191:85 , srv2054205226:85 , srv2088234168:85 , srv259272077:85 , srv346380697:85 , srv387287567:85 , srv393640126:85 , srv415209564:85 , srv535790806:85 , srv583353648:85 , srv584266414:85 , srv603861991:85 , srv655540398:85 , srv695341497:85 , srv801326526:85 , srv888204036:85 , srv989796465:85 , srv1011160570:86 , srv1071255983:86 , srv1324918650:86 , srv1350656743:86 , srv1437215099:86 , srv1498147604:86 , srv1664220168:86 , srv1692092290:86 , srv1820061448:86 , srv18260927:86 , srv2027554757:86 , srv260206682:86 , srv266591109:86 , srv499735613:86 , srv580973575:86 , srv592622451:86 , srv663583090:86 , srv73171138:86 , srv895512727:86 , srv902810798:86 , srv1035691963:87 , srv1104698755:87 , srv1163559274:87 , srv1895045783:87 , srv1930166335:87 , srv1980313453:87 , srv287113484:87 , srv328694533:87 , srv333707459:87 , srv419226487:87 , srv421290187:87 , srv481909061:87 , srv536639698:87 , srv689246379:87 , srv737702651:87 , srv873231842:87 , srv998400482:87 , srv1239046614:88 , srv1550613211:88 , srv1565440948:88 , srv1585023840:88 , srv519628472:88 , srv625757727:88 , srv1758034891:89 , srv1903850715:89 , srv555216583:541 }
2023-08-08 16:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:13,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:13,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:13,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:13,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:13,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:13,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:13,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:13,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:13,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:13,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:13,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:13,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:13,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:13,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005457038961169203); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005457038961169203); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:13,180 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-08 16:53:13,180 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.480814277983167E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005457038961169203); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005457038961169203); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-08 16:53:13,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 584 ms to try 5000 different iterations.  Found a solution that moves 264 regions; Going from a computed imbalance of 8.480814277983167E-4 to a new imbalance of 3.502062574667083E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.029333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:13,637 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011160570:83 , srv1163559274:83 , srv1550613211:83 , srv1585023840:83 , srv1815857513:83 , srv1903850715:83 , srv266591109:83 , srv393640126:83 , srv431367604:83 , srv580973575:83 , srv592622451:83 , srv1081845780:84 , srv1239046614:84 , srv1296947294:84 , srv1379285469:84 , srv1437215099:84 , srv1539322931:84 , srv1565440948:84 , srv1598160066:84 , srv1685142782:84 , srv1692092290:84 , srv1748329055:84 , srv1758034891:84 , srv18260927:84 , srv1895045783:84 , srv1980313453:84 , srv2052554191:84 , srv259272077:84 , srv287113484:84 , srv328694533:84 , srv333707459:84 , srv387287567:84 , srv419226487:84 , srv481909061:84 , srv519628472:84 , srv583353648:84 , srv584266414:84 , srv625757727:84 , srv655540398:84 , srv73171138:84 , srv737702651:84 , srv801326526:84 , srv848868952:84 , srv873231842:84 , srv902810798:84 , srv989796465:84 , srv998400482:84 , srv1035691963:85 , srv1071255983:85 , srv1104698755:85 , srv1162693167:85 , srv1207824822:85 , srv12397647:85 , srv1324918650:85 , srv1350656743:85 , srv1431672165:85 , srv1491132875:85 , srv1498147604:85 , srv156528691:85 , srv1636404759:85 , srv1663437871:85 , srv1677489219:85 , srv1730892444:85 , srv1731209544:85 , srv1805762737:85 , srv1820061448:85 , srv1889424613:85 , srv1921057119:85 , srv1930166335:85 , srv2022364526:85 , srv2027554757:85 , srv2054205226:85 , srv2088234168:85 , srv2131424887:85 , srv260206682:85 , srv292975113:85 , srv304176271:85 , srv346380697:85 , srv415209564:85 , srv421290187:85 , srv499735613:85 , srv535790806:85 , srv536639698:85 , srv555399877:85 , srv603861991:85 , srv650612961:85 , srv663583090:85 , srv695341497:85 , srv759457950:85 , srv807380582:85 , srv888204036:85 , srv895512727:85 , srv1630446218:86 , srv1664220168:86 , srv1750808685:86 , srv416085300:86 , srv452047609:86 , srv513902751:86 , srv689246379:86 , srv555216583:636 }
2023-08-08 16:53:13,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:13,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:13,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:13,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:13,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:13,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:13,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:13,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:13,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:13,804 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-08 16:53:13,804 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.317205823644519E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-08 16:53:14,145 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 3.317205823644519E-5 to a new imbalance of 6.93312709465048E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:14,146 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1162693167:83 , srv1630446218:83 , srv1636404759:83 , srv1750808685:83 , srv1820061448:83 , srv346380697:83 , srv650612961:83 , srv689246379:83 , srv695341497:83 , srv737702651:83 , srv1011160570:84 , srv1035691963:84 , srv1071255983:84 , srv1104698755:84 , srv1163559274:84 , srv1207824822:84 , srv1239046614:84 , srv12397647:84 , srv1296947294:84 , srv1324918650:84 , srv1350656743:84 , srv1379285469:84 , srv1431672165:84 , srv1437215099:84 , srv1491132875:84 , srv1498147604:84 , srv1539322931:84 , srv156528691:84 , srv1585023840:84 , srv1663437871:84 , srv1664220168:84 , srv1677489219:84 , srv1685142782:84 , srv1692092290:84 , srv1730892444:84 , srv1731209544:84 , srv1748329055:84 , srv1758034891:84 , srv1805762737:84 , srv1815857513:84 , srv18260927:84 , srv1889424613:84 , srv1895045783:84 , srv1903850715:84 , srv1930166335:84 , srv1980313453:84 , srv2022364526:84 , srv2027554757:84 , srv2052554191:84 , srv2054205226:84 , srv2131424887:84 , srv259272077:84 , srv260206682:84 , srv266591109:84 , srv287113484:84 , srv292975113:84 , srv304176271:84 , srv328694533:84 , srv333707459:84 , srv387287567:84 , srv393640126:84 , srv415209564:84 , srv419226487:84 , srv421290187:84 , srv452047609:84 , srv481909061:84 , srv499735613:84 , srv513902751:84 , srv535790806:84 , srv536639698:84 , srv555399877:84 , srv580973575:84 , srv583353648:84 , srv584266414:84 , srv592622451:84 , srv603861991:84 , srv625757727:84 , srv655540398:84 , srv663583090:84 , srv73171138:84 , srv759457950:84 , srv801326526:84 , srv807380582:84 , srv848868952:84 , srv873231842:84 , srv888204036:84 , srv895512727:84 , srv902810798:84 , srv989796465:84 , srv1081845780:85 , srv1550613211:85 , srv1565440948:85 , srv1598160066:85 , srv1921057119:85 , srv2088234168:85 , srv416085300:85 , srv431367604:85 , srv519628472:85 , srv998400482:85 , srv555216583:684 }
2023-08-08 16:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2131424887=51, srv346380697=60, srv304176271=57, srv292975113=56, srv259272077=52, srv1750808685=34, srv1664220168=27, srv499735613=70, srv989796465=98, srv759457950=90, srv387287567=61, srv888204036=95, srv328694533=58, srv1071255983=2, srv801326526=91, srv695341497=87, srv419226487=65, srv1758034891=35, srv12397647=9, srv1663437871=26, srv848868952=93, srv1731209544=32, srv1491132875=16, srv1207824822=7, srv1296947294=10, srv1431672165=14, srv266591109=54, srv393640126=62, srv481909061=69, srv1730892444=31, srv1035691963=1, srv873231842=94, srv650612961=83, srv2088234168=50, srv592622451=80, srv555399877=76, srv1598160066=23, srv625757727=82, srv513902751=71, srv895512727=96, srv1805762737=36, srv1903850715=42, srv421290187=66, srv536639698=74, srv1677489219=28, srv415209564=63, srv333707459=59, srv1685142782=29, srv555216583=75, srv431367604=67, srv1585023840=22, srv2022364526=46, srv603861991=81, srv1692092290=30, srv2027554757=47, srv73171138=88, srv1820061448=38, srv416085300=64, srv580973575=77, srv1895045783=41, srv1104698755=4, srv1162693167=5, srv1498147604=17, srv1379285469=13, srv1748329055=33, srv663583090=85, srv1539322931=18, srv1980313453=45, srv737702651=89, srv1011160570=0, srv1636404759=25, srv584266414=79, srv1324918650=11, srv583353648=78, srv2054205226=49, srv535790806=73, srv1081845780=3, srv689246379=86, srv156528691=20, srv1437215099=15, srv1815857513=37, srv1889424613=40, srv1921057119=43, srv1630446218=24, srv902810798=97, srv998400482=99, srv1565440948=21, srv807380582=92, srv260206682=53, srv655540398=84, srv519628472=72, srv2052554191=48, srv18260927=39, srv1930166335=44, srv1550613211=19, srv1239046614=8, srv287113484=55, srv1350656743=12, srv1163559274=6, srv452047609=68} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:14,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:14,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-08 16:53:14,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-08 16:53:14,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-08 16:53:14,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-08 16:53:14,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-08 16:53:14,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-08 16:53:14,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-08 16:53:14,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-08 16:53:14,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-08 16:53:14,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:14,314 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1162693167:83 , srv1630446218:83 , srv1636404759:83 , srv1750808685:83 , srv1820061448:83 , srv346380697:83 , srv650612961:83 , srv689246379:83 , srv695341497:83 , srv737702651:83 , srv1011160570:84 , srv1035691963:84 , srv1071255983:84 , srv1104698755:84 , srv1163559274:84 , srv1207824822:84 , srv1239046614:84 , srv12397647:84 , srv1296947294:84 , srv1324918650:84 , srv1350656743:84 , srv1379285469:84 , srv1431672165:84 , srv1437215099:84 , srv1491132875:84 , srv1498147604:84 , srv1539322931:84 , srv156528691:84 , srv1585023840:84 , srv1663437871:84 , srv1664220168:84 , srv1677489219:84 , srv1685142782:84 , srv1692092290:84 , srv1730892444:84 , srv1731209544:84 , srv1748329055:84 , srv1758034891:84 , srv1805762737:84 , srv1815857513:84 , srv18260927:84 , srv1889424613:84 , srv1895045783:84 , srv1903850715:84 , srv1930166335:84 , srv1980313453:84 , srv2022364526:84 , srv2027554757:84 , srv2052554191:84 , srv2054205226:84 , srv2131424887:84 , srv259272077:84 , srv260206682:84 , srv266591109:84 , srv287113484:84 , srv292975113:84 , srv304176271:84 , srv328694533:84 , srv333707459:84 , srv387287567:84 , srv393640126:84 , srv415209564:84 , srv419226487:84 , srv421290187:84 , srv452047609:84 , srv481909061:84 , srv499735613:84 , srv513902751:84 , srv535790806:84 , srv536639698:84 , srv555399877:84 , srv580973575:84 , srv583353648:84 , srv584266414:84 , srv592622451:84 , srv603861991:84 , srv625757727:84 , srv655540398:84 , srv663583090:84 , srv73171138:84 , srv759457950:84 , srv801326526:84 , srv807380582:84 , srv848868952:84 , srv873231842:84 , srv888204036:84 , srv895512727:84 , srv902810798:84 , srv989796465:84 , srv1081845780:85 , srv1550613211:85 , srv1565440948:85 , srv1598160066:85 , srv1921057119:85 , srv2088234168:85 , srv416085300:85 , srv431367604:85 , srv519628472:85 , srv998400482:85 , srv555216583:684 }
2023-08-08 16:53:14,341 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=320 (was 313) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=2207 (was 2993)
2023-08-08 16:53:14,350 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=320, ProcessCount=173, AvailableMemoryMB=2207
2023-08-08 16:53:14,351 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-08 16:53:14,351 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-08 16:53:14,365 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1032602974:84 , srv1068911827:84 , srv112464439:84 , srv1188180038:84 , srv1236223213:84 , srv1318123751:84 , srv1347124159:84 , srv1504674411:84 , srv1551140853:84 , srv1714186102:84 , srv1888598477:84 , srv1935062886:84 , srv1936965772:84 , srv1951670156:84 , srv2044975654:84 , srv2086782137:84 , srv215469221:84 , srv239758657:84 , srv259479774:84 , srv315421474:84 , srv316007969:84 , srv317970449:84 , srv323751154:84 , srv346424480:84 , srv376602398:84 , srv741318300:84 , srv808723689:84 , srv816299209:84 , srv932444246:84 , srv1097530190:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-08 16:53:14,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:53:14,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv932444246=29, srv315421474=20, srv1188180038=4, srv316007969=21, srv112464439=3, srv346424480=24, srv808723689=27, srv1236223213=5, srv1551140853=9, srv1504674411=8, srv1318123751=6, srv816299209=28, srv1097530190=2, srv2086782137=16, srv1347124159=7, srv741318300=26, srv239758657=18, srv259479774=19, srv376602398=25, srv1935062886=12, srv2044975654=15, srv1032602974=0, srv1714186102=10, srv215469221=17, srv1888598477=11, srv323751154=23, srv1068911827=1, srv1936965772=13, srv317970449=22, srv1951670156=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:53:14,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:53:14,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:53:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-08 16:53:14,404 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1423897665896816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:53:14,404 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991264170876935, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1423897665896816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-08 16:55:14,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5570811 different iterations.  Found a solution that moves 1879 regions; Going from a computed imbalance of 0.991264170876935 to a new imbalance of 4.385679737012596E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.695925925925926, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:55:14,396 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1032602974:90 , srv1068911827:90 , srv1097530190:90 , srv112464439:90 , srv1188180038:90 , srv1236223213:90 , srv1318123751:90 , srv1347124159:90 , srv1504674411:90 , srv1551140853:90 , srv1714186102:90 , srv1888598477:90 , srv1935062886:90 , srv1936965772:90 , srv1951670156:90 , srv2044975654:90 , srv2086782137:90 , srv215469221:90 , srv239758657:90 , srv259479774:90 , srv315421474:90 , srv316007969:90 , srv317970449:90 , srv323751154:90 , srv346424480:90 , srv376602398:90 , srv741318300:90 , srv808723689:90 , srv816299209:90 , srv932444246:90 }
2023-08-08 16:55:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-08 16:55:14,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv932444246=29, srv315421474=20, srv1188180038=4, srv316007969=21, srv112464439=3, srv346424480=24, srv808723689=27, srv1236223213=5, srv1551140853=9, srv1504674411=8, srv1318123751=6, srv816299209=28, srv1097530190=2, srv2086782137=16, srv1347124159=7, srv741318300=26, srv239758657=18, srv259479774=19, srv376602398=25, srv1935062886=12, srv2044975654=15, srv1032602974=0, srv1714186102=10, srv215469221=17, srv1888598477=11, srv323751154=23, srv1068911827=1, srv1936965772=13, srv317970449=22, srv1951670156=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-08 16:55:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-08 16:55:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-08 16:55:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-08 16:55:14,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-08 16:55:14,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-08 16:55:14,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-08 16:55:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-08 16:55:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-08 16:55:14,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-08 16:55:14,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-08 16:55:14,424 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1032602974:90 , srv1068911827:90 , srv1097530190:90 , srv112464439:90 , srv1188180038:90 , srv1236223213:90 , srv1318123751:90 , srv1347124159:90 , srv1504674411:90 , srv1551140853:90 , srv1714186102:90 , srv1888598477:90 , srv1935062886:90 , srv1936965772:90 , srv1951670156:90 , srv2044975654:90 , srv2086782137:90 , srv215469221:90 , srv239758657:90 , srv259479774:90 , srv315421474:90 , srv316007969:90 , srv317970449:90 , srv323751154:90 , srv346424480:90 , srv376602398:90 , srv741318300:90 , srv808723689:90 , srv816299209:90 , srv932444246:90 }
2023-08-08 16:55:14,440 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 320), ProcessCount=171 (was 173), AvailableMemoryMB=2239 (was 2207) - AvailableMemoryMB LEAK? -