2023-04-29 05:53:32,841 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-29 05:53:33,174 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-29 05:53:33,294 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-29 05:53:33,357 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-29 05:53:33,365 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-29 05:53:33,378 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=170, AvailableMemoryMB=12640
2023-04-29 05:53:33,380 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-29 05:53:33,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-29 05:53:33,514 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011725204:84 , srv1052039223:84 , srv1064021548:84 , srv1064550685:84 , srv1069069255:84 , srv1084889170:84 , srv1096171243:84 , srv1096773947:84 , srv1127173441:84 , srv1141909486:84 , srv1157415036:84 , srv1182696032:84 , srv1210811731:84 , srv1216080797:84 , srv1228459226:84 , srv1246042079:84 , srv1310201746:84 , srv1317880893:84 , srv1344010056:84 , srv1388038011:84 , srv1389903775:84 , srv141563739:84 , srv1422576178:84 , srv1442105471:84 , srv1477079078:84 , srv1488705686:84 , srv1498434867:84 , srv151152436:84 , srv1573746666:84 , srv1578686030:84 , srv1579410032:84 , srv1584469392:84 , srv1658689806:84 , srv1661581202:84 , srv1705312125:84 , srv1713317743:84 , srv1725607922:84 , srv1738952077:84 , srv1743057429:84 , srv174497053:84 , srv1746389664:84 , srv175703706:84 , srv1767453327:84 , srv1769857124:84 , srv1770169482:84 , srv1828031139:84 , srv1834125169:84 , srv1856568787:84 , srv1856832601:84 , srv1858190782:84 , srv187108162:84 , srv1871699762:84 , srv187897763:84 , srv1881312082:84 , srv191505914:84 , srv1925171943:84 , srv1986113087:84 , srv2004043510:84 , srv2006433826:84 , srv2008246422:84 , srv2010127464:84 , srv2030188665:84 , srv203670448:84 , srv2050532037:84 , srv2082028103:84 , srv2093472662:84 , srv2119976237:84 , srv2123284604:84 , srv231846002:84 , srv251949677:84 , srv265079066:84 , srv266116142:84 , srv296211823:84 , srv326715097:84 , srv327370610:84 , srv35481403:84 , srv37210479:84 , srv374053399:84 , srv378154473:84 , srv381430183:84 , srv392122125:84 , srv423990527:84 , srv469531945:84 , srv540625922:84 , srv55973508:84 , srv57089655:84 , srv589621692:84 , srv610652881:84 , srv612643744:84 , srv668956377:84 , srv677756631:84 , srv710491909:84 , srv719949257:84 , srv742905773:84 , srv762571111:84 , srv775768686:84 , srv795818717:84 , srv905432865:84 , srv905946213:84 , srv102349019:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-29 05:53:33,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:33,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:33,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:33,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:33,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:33,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:33,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:33,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:33,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:33,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:33,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:33,880 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-29 05:53:33,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-29 05:53:34,240 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 572 ms to try 5000 different iterations.  Found a solution that moves 4693 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1763272214817626. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038718723423997174, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056401638106927186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5214444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038718723423997174, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:34,255 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1228459226:81 , srv1828031139:82 , srv251949677:82 , srv469531945:82 , srv677756631:82 , srv1317880893:83 , srv141563739:83 , srv1579410032:83 , srv187108162:83 , srv326715097:83 , srv37210479:83 , srv762571111:83 , srv1141909486:84 , srv1344010056:84 , srv1389903775:84 , srv1488705686:84 , srv1770169482:84 , srv1834125169:84 , srv1856568787:84 , srv2119976237:84 , srv2123284604:84 , srv296211823:84 , srv589621692:84 , srv1084889170:85 , srv1157415036:85 , srv1210811731:85 , srv1216080797:85 , srv1388038011:85 , srv175703706:85 , srv2004043510:85 , srv2030188665:85 , srv55973508:85 , srv1052039223:86 , srv1096171243:86 , srv1182696032:86 , srv1573746666:86 , srv1725607922:86 , srv1986113087:86 , srv2008246422:86 , srv2010127464:86 , srv327370610:86 , srv374053399:86 , srv378154473:86 , srv381430183:86 , srv795818717:86 , srv905946213:86 , srv1096773947:87 , srv1310201746:87 , srv1422576178:87 , srv1477079078:87 , srv1578686030:87 , srv1661581202:87 , srv174497053:87 , srv1746389664:87 , srv1767453327:87 , srv1871699762:87 , srv1881312082:87 , srv191505914:87 , srv203670448:87 , srv2093472662:87 , srv231846002:87 , srv265079066:87 , srv423990527:87 , srv540625922:87 , srv610652881:87 , srv668956377:87 , srv710491909:87 , srv742905773:87 , srv775768686:87 , srv1011725204:88 , srv1064021548:88 , srv1127173441:88 , srv1442105471:88 , srv1498434867:88 , srv151152436:88 , srv1658689806:88 , srv1705312125:88 , srv1738952077:88 , srv2006433826:88 , srv2050532037:88 , srv266116142:88 , srv35481403:88 , srv612643744:88 , srv905432865:88 , srv1064550685:89 , srv1069069255:89 , srv1246042079:89 , srv1856832601:89 , srv1858190782:89 , srv392122125:89 , srv1713317743:90 , srv1743057429:90 , srv1769857124:90 , srv57089655:90 , srv1584469392:91 , srv1925171943:92 , srv719949257:94 , srv2082028103:95 , srv187897763:96 , srv102349019:434 }
2023-04-29 05:53:34,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:34,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:34,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:34,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:34,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:34,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:34,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:34,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:34,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:34,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:34,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:34,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:34,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:34,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:34,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:34,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:34,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:34,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:34,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:34,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:34,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:34,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:34,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:34,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:34,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:34,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:34,292 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:34,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:34,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:34,293 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:34,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038718723423997174, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056401638106927186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038718723423997174, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:34,416 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-29 05:53:34,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17629436039340848, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038718723423997174, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056401638106927186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038718723423997174, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-29 05:53:34,740 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 423 ms to try 5000 different iterations.  Found a solution that moves 2610 regions; Going from a computed imbalance of 0.17629436039340848 to a new imbalance of 0.015031773082550725. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02261548765405363); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036109945591136484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02261548765405363); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:34,761 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv187897763:76 , srv2082028103:77 , srv719949257:77 , srv1925171943:80 , srv1064550685:81 , srv1743057429:81 , srv1856832601:81 , srv1858190782:81 , srv151152436:82 , srv1584469392:82 , srv1658689806:82 , srv1738952077:82 , srv2050532037:82 , srv57089655:82 , srv1127173441:83 , srv1422576178:83 , srv1661581202:83 , srv1713317743:83 , srv266116142:83 , srv1052039223:84 , srv1069069255:84 , srv1310201746:84 , srv1442105471:84 , srv1477079078:84 , srv174497053:84 , srv1769857124:84 , srv191505914:84 , srv2008246422:84 , srv2093472662:84 , srv35481403:84 , srv392122125:84 , srv610652881:84 , srv612643744:84 , srv668956377:84 , srv742905773:84 , srv775768686:84 , srv1064021548:85 , srv1096171243:85 , srv1246042079:85 , srv1498434867:85 , srv1573746666:85 , srv1705312125:85 , srv1767453327:85 , srv1871699762:85 , srv203670448:85 , srv231846002:85 , srv265079066:85 , srv374053399:85 , srv795818717:85 , srv1084889170:86 , srv1096773947:86 , srv1210811731:86 , srv1344010056:86 , srv1578686030:86 , srv1725607922:86 , srv1746389664:86 , srv1881312082:86 , srv1986113087:86 , srv2006433826:86 , srv2010127464:86 , srv327370610:86 , srv378154473:86 , srv540625922:86 , srv55973508:86 , srv710491909:86 , srv1011725204:87 , srv1157415036:87 , srv1182696032:87 , srv1216080797:87 , srv1389903775:87 , srv1488705686:87 , srv2004043510:87 , srv2119976237:87 , srv2123284604:87 , srv326715097:87 , srv423990527:87 , srv589621692:87 , srv905946213:87 , srv1317880893:88 , srv1388038011:88 , srv141563739:88 , srv175703706:88 , srv2030188665:88 , srv381430183:88 , srv1579410032:89 , srv1828031139:89 , srv1856568787:89 , srv187108162:89 , srv469531945:89 , srv1141909486:90 , srv1834125169:90 , srv251949677:90 , srv296211823:90 , srv37210479:90 , srv677756631:90 , srv762571111:90 , srv1770169482:91 , srv905432865:91 , srv1228459226:93 , srv102349019:541 }
2023-04-29 05:53:34,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:34,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:34,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:34,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02261548765405363); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036109945591136484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02261548765405363); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:34,959 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-29 05:53:34,960 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015013497471938269, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02261548765405363); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.036109945591136484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02261548765405363); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042916666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-29 05:53:35,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 938 regions; Going from a computed imbalance of 0.015013497471938269 to a new imbalance of 5.948697764227871E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008254584898217204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010194516692557684); MoveCostFunction : (multiplier=7.0, imbalance=0.10422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008254584898217204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:35,326 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv905432865:80 , srv1141909486:82 , srv1769857124:82 , srv1011725204:83 , srv1246042079:83 , srv1770169482:83 , srv2006433826:83 , srv296211823:83 , srv1069069255:84 , srv1157415036:84 , srv1388038011:84 , srv1584469392:84 , srv1713317743:84 , srv1746389664:84 , srv1834125169:84 , srv1871699762:84 , srv187897763:84 , srv37210479:84 , srv381430183:84 , srv710491909:84 , srv905946213:84 , srv1096773947:85 , srv1216080797:85 , srv1228459226:85 , srv1317880893:85 , srv1389903775:85 , srv1442105471:85 , srv1578686030:85 , srv1579410032:85 , srv1705312125:85 , srv174497053:85 , srv175703706:85 , srv1767453327:85 , srv1856568787:85 , srv187108162:85 , srv1881312082:85 , srv1986113087:85 , srv2010127464:85 , srv2030188665:85 , srv2093472662:85 , srv231846002:85 , srv251949677:85 , srv265079066:85 , srv327370610:85 , srv35481403:85 , srv374053399:85 , srv378154473:85 , srv392122125:85 , srv540625922:85 , srv55973508:85 , srv589621692:85 , srv677756631:85 , srv719949257:85 , srv762571111:85 , srv795818717:85 , srv1064550685:86 , srv1084889170:86 , srv1127173441:86 , srv1182696032:86 , srv1210811731:86 , srv1310201746:86 , srv141563739:86 , srv1477079078:86 , srv1488705686:86 , srv151152436:86 , srv1573746666:86 , srv1661581202:86 , srv1725607922:86 , srv1738952077:86 , srv1743057429:86 , srv1828031139:86 , srv191505914:86 , srv1925171943:86 , srv2004043510:86 , srv2082028103:86 , srv2119976237:86 , srv2123284604:86 , srv423990527:86 , srv469531945:86 , srv57089655:86 , srv612643744:86 , srv668956377:86 , srv742905773:86 , srv1064021548:87 , srv1096171243:87 , srv1422576178:87 , srv1498434867:87 , srv1658689806:87 , srv1856832601:87 , srv1858190782:87 , srv2008246422:87 , srv203670448:87 , srv2050532037:87 , srv266116142:87 , srv610652881:87 , srv775768686:87 , srv1052039223:88 , srv1344010056:88 , srv326715097:88 , srv102349019:556 }
2023-04-29 05:53:35,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:35,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:35,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:35,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:35,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:35,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:35,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:35,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:35,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:35,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:35,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:35,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:35,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:35,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:35,521 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008254584898217204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010194516692557684); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008254584898217204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:35,522 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-29 05:53:35,522 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.883017600417582E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008254584898217204); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010194516692557684); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008254584898217204); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-29 05:53:35,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 502 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 5.883017600417582E-4 to a new imbalance of 2.8182727203614057E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:35,893 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1064021548:82 , srv1498434867:82 , srv423990527:82 , srv1182696032:83 , srv1228459226:83 , srv612643744:83 , srv905432865:83 , srv1011725204:84 , srv1052039223:84 , srv1096171243:84 , srv1096773947:84 , srv1246042079:84 , srv1344010056:84 , srv1705312125:84 , srv1725607922:84 , srv175703706:84 , srv1770169482:84 , srv1834125169:84 , srv1856568787:84 , srv1856832601:84 , srv1881312082:84 , srv1925171943:84 , srv2004043510:84 , srv2010127464:84 , srv2030188665:84 , srv203670448:84 , srv2050532037:84 , srv2082028103:84 , srv266116142:84 , srv326715097:84 , srv392122125:84 , srv540625922:84 , srv57089655:84 , srv610652881:84 , srv668956377:84 , srv762571111:84 , srv775768686:84 , srv1069069255:85 , srv1084889170:85 , srv1127173441:85 , srv1210811731:85 , srv1216080797:85 , srv1310201746:85 , srv1388038011:85 , srv141563739:85 , srv1442105471:85 , srv1477079078:85 , srv1488705686:85 , srv1573746666:85 , srv1578686030:85 , srv1579410032:85 , srv1584469392:85 , srv1658689806:85 , srv1713317743:85 , srv1743057429:85 , srv1746389664:85 , srv1767453327:85 , srv1769857124:85 , srv1828031139:85 , srv1858190782:85 , srv187108162:85 , srv191505914:85 , srv1986113087:85 , srv2006433826:85 , srv2008246422:85 , srv2119976237:85 , srv2123284604:85 , srv231846002:85 , srv251949677:85 , srv265079066:85 , srv296211823:85 , srv327370610:85 , srv35481403:85 , srv37210479:85 , srv378154473:85 , srv381430183:85 , srv469531945:85 , srv677756631:85 , srv710491909:85 , srv905946213:85 , srv1141909486:86 , srv1317880893:86 , srv1389903775:86 , srv1422576178:86 , srv151152436:86 , srv1661581202:86 , srv1738952077:86 , srv174497053:86 , srv1871699762:86 , srv187897763:86 , srv2093472662:86 , srv374053399:86 , srv55973508:86 , srv589621692:86 , srv719949257:86 , srv742905773:86 , srv795818717:86 , srv1064550685:87 , srv1157415036:87 , srv102349019:611 }
2023-04-29 05:53:35,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:35,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:35,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:35,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:35,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:35,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:35,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:35,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:35,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:35,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:35,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:35,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:35,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:35,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:35,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:35,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:36,029 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:36,030 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-29 05:53:36,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.631315324440858E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-29 05:53:36,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 405 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 2.631315324440858E-5 to a new imbalance of 7.290305935787761E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:36,341 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1064550685:83 , srv1157415036:83 , srv1422576178:83 , srv1578686030:83 , srv203670448:83 , srv381430183:83 , srv742905773:83 , srv1011725204:84 , srv1052039223:84 , srv1064021548:84 , srv1069069255:84 , srv1084889170:84 , srv1096171243:84 , srv1096773947:84 , srv1127173441:84 , srv1141909486:84 , srv1182696032:84 , srv1210811731:84 , srv1216080797:84 , srv1228459226:84 , srv1310201746:84 , srv1317880893:84 , srv1344010056:84 , srv1388038011:84 , srv1389903775:84 , srv141563739:84 , srv1442105471:84 , srv1477079078:84 , srv1488705686:84 , srv1498434867:84 , srv151152436:84 , srv1573746666:84 , srv1579410032:84 , srv1584469392:84 , srv1658689806:84 , srv1661581202:84 , srv1705312125:84 , srv1713317743:84 , srv1725607922:84 , srv1738952077:84 , srv1743057429:84 , srv174497053:84 , srv1746389664:84 , srv175703706:84 , srv1767453327:84 , srv1770169482:84 , srv1828031139:84 , srv1834125169:84 , srv1856568787:84 , srv1858190782:84 , srv187108162:84 , srv1871699762:84 , srv187897763:84 , srv1881312082:84 , srv191505914:84 , srv1925171943:84 , srv1986113087:84 , srv2004043510:84 , srv2006433826:84 , srv2008246422:84 , srv2030188665:84 , srv2082028103:84 , srv2093472662:84 , srv2119976237:84 , srv2123284604:84 , srv231846002:84 , srv251949677:84 , srv265079066:84 , srv266116142:84 , srv296211823:84 , srv326715097:84 , srv327370610:84 , srv35481403:84 , srv37210479:84 , srv374053399:84 , srv378154473:84 , srv392122125:84 , srv423990527:84 , srv469531945:84 , srv540625922:84 , srv55973508:84 , srv57089655:84 , srv589621692:84 , srv610652881:84 , srv677756631:84 , srv710491909:84 , srv719949257:84 , srv762571111:84 , srv775768686:84 , srv795818717:84 , srv905432865:84 , srv905946213:84 , srv1246042079:85 , srv1769857124:85 , srv1856832601:85 , srv2010127464:85 , srv2050532037:85 , srv612643744:85 , srv668956377:85 , srv102349019:684 }
2023-04-29 05:53:36,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:36,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv175703706=42, srv381430183=80, srv1246042079=16, srv1498434867=27, srv1096773947=8, srv374053399=78, srv1725607922=37, srv1770169482=45, srv1858190782=50, srv1011725204=0, srv2004043510=58, srv1127173441=9, srv151152436=28, srv1705312125=35, srv2010127464=61, srv327370610=75, srv1738952077=38, srv1881312082=54, srv1925171943=56, srv266116142=72, srv2082028103=65, srv265079066=71, srv141563739=22, srv589621692=87, srv55973508=85, srv612643744=89, srv905946213=99, srv102349019=1, srv2050532037=64, srv187108162=51, srv795818717=97, srv2119976237=67, srv1084889170=6, srv1064550685=4, srv2008246422=60, srv1713317743=36, srv710491909=92, srv742905773=94, srv1069069255=5, srv1141909486=10, srv677756631=91, srv326715097=74, srv2123284604=68, srv37210479=77, srv392122125=81, srv1871699762=52, srv775768686=96, srv296211823=73, srv423990527=82, srv1388038011=20, srv1746389664=41, srv1064021548=3, srv1578686030=30, srv2093472662=66, srv1052039223=2, srv231846002=69, srv1317880893=18, srv1834125169=47, srv1769857124=44, srv1856568787=48, srv762571111=95, srv1182696032=12, srv1096171243=7, srv203670448=63, srv1157415036=11, srv2030188665=62, srv719949257=93, srv2006433826=59, srv469531945=83, srv1488705686=26, srv1828031139=46, srv1216080797=14, srv610652881=88, srv1743057429=39, srv35481403=76, srv540625922=84, srv905432865=98, srv57089655=86, srv1344010056=19, srv1573746666=29, srv1477079078=25, srv1422576178=23, srv378154473=79, srv174497053=40, srv251949677=70, srv668956377=90, srv1661581202=34, srv1442105471=24, srv1658689806=33, srv1228459226=15, srv1579410032=31, srv1767453327=43, srv1210811731=13, srv187897763=53, srv1389903775=21, srv191505914=55, srv1856832601=49, srv1310201746=17, srv1584469392=32, srv1986113087=57} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:36,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:36,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:36,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-29 05:53:36,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-29 05:53:36,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-29 05:53:36,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-29 05:53:36,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-29 05:53:36,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-29 05:53:36,492 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:36,492 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1064550685:83 , srv1157415036:83 , srv1422576178:83 , srv1578686030:83 , srv203670448:83 , srv381430183:83 , srv742905773:83 , srv1011725204:84 , srv1052039223:84 , srv1064021548:84 , srv1069069255:84 , srv1084889170:84 , srv1096171243:84 , srv1096773947:84 , srv1127173441:84 , srv1141909486:84 , srv1182696032:84 , srv1210811731:84 , srv1216080797:84 , srv1228459226:84 , srv1310201746:84 , srv1317880893:84 , srv1344010056:84 , srv1388038011:84 , srv1389903775:84 , srv141563739:84 , srv1442105471:84 , srv1477079078:84 , srv1488705686:84 , srv1498434867:84 , srv151152436:84 , srv1573746666:84 , srv1579410032:84 , srv1584469392:84 , srv1658689806:84 , srv1661581202:84 , srv1705312125:84 , srv1713317743:84 , srv1725607922:84 , srv1738952077:84 , srv1743057429:84 , srv174497053:84 , srv1746389664:84 , srv175703706:84 , srv1767453327:84 , srv1770169482:84 , srv1828031139:84 , srv1834125169:84 , srv1856568787:84 , srv1858190782:84 , srv187108162:84 , srv1871699762:84 , srv187897763:84 , srv1881312082:84 , srv191505914:84 , srv1925171943:84 , srv1986113087:84 , srv2004043510:84 , srv2006433826:84 , srv2008246422:84 , srv2030188665:84 , srv2082028103:84 , srv2093472662:84 , srv2119976237:84 , srv2123284604:84 , srv231846002:84 , srv251949677:84 , srv265079066:84 , srv266116142:84 , srv296211823:84 , srv326715097:84 , srv327370610:84 , srv35481403:84 , srv37210479:84 , srv374053399:84 , srv378154473:84 , srv392122125:84 , srv423990527:84 , srv469531945:84 , srv540625922:84 , srv55973508:84 , srv57089655:84 , srv589621692:84 , srv610652881:84 , srv677756631:84 , srv710491909:84 , srv719949257:84 , srv762571111:84 , srv775768686:84 , srv795818717:84 , srv905432865:84 , srv905946213:84 , srv1246042079:85 , srv1769857124:85 , srv1856832601:85 , srv2010127464:85 , srv2050532037:85 , srv612643744:85 , srv668956377:85 , srv102349019:684 }
2023-04-29 05:53:36,527 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=401 (was 384) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=11766 (was 12640)
2023-04-29 05:53:36,540 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=401, ProcessCount=170, AvailableMemoryMB=11766
2023-04-29 05:53:36,541 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-29 05:53:36,542 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-29 05:53:36,555 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010773339:84 , srv1136712353:84 , srv11933409:84 , srv1268632515:84 , srv1322974487:84 , srv1327990073:84 , srv1405895405:84 , srv156986168:84 , srv1796709674:84 , srv1821842926:84 , srv1830950994:84 , srv1910164434:84 , srv1912132475:84 , srv1917594602:84 , srv1961269054:84 , srv2086822781:84 , srv30519625:84 , srv42449425:84 , srv435237351:84 , srv443063047:84 , srv45691801:84 , srv615893667:84 , srv654608882:84 , srv69460954:84 , srv698077489:84 , srv741876793:84 , srv887923839:84 , srv912334441:84 , srv986941260:84 , srv1386779993:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-29 05:53:36,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:53:36,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1912132475=13, srv1405895405=7, srv741876793=26, srv1917594602=14, srv654608882=23, srv1268632515=3, srv887923839=27, srv11933409=2, srv1830950994=11, srv1386779993=6, srv30519625=17, srv986941260=29, srv615893667=22, srv698077489=25, srv1010773339=0, srv1327990073=5, srv912334441=28, srv1821842926=10, srv1322974487=4, srv435237351=19, srv45691801=21, srv2086822781=16, srv1910164434=12, srv1136712353=1, srv156986168=8, srv69460954=24, srv1961269054=15, srv42449425=18, srv443063047=20, srv1796709674=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:53:36,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:53:36,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:53:36,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-29 05:53:36,596 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.150324062387272, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:53:36,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991266670947633, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.150324062387272, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-29 05:55:36,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6334737 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.991266670947633 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:55:36,584 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010773339:90 , srv1136712353:90 , srv11933409:90 , srv1268632515:90 , srv1322974487:90 , srv1327990073:90 , srv1386779993:90 , srv1405895405:90 , srv156986168:90 , srv1796709674:90 , srv1821842926:90 , srv1830950994:90 , srv1910164434:90 , srv1912132475:90 , srv1917594602:90 , srv1961269054:90 , srv2086822781:90 , srv30519625:90 , srv42449425:90 , srv435237351:90 , srv443063047:90 , srv45691801:90 , srv615893667:90 , srv654608882:90 , srv69460954:90 , srv698077489:90 , srv741876793:90 , srv887923839:90 , srv912334441:90 , srv986941260:90 }
2023-04-29 05:55:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-29 05:55:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1912132475=13, srv1405895405=7, srv741876793=26, srv1917594602=14, srv654608882=23, srv1268632515=3, srv887923839=27, srv11933409=2, srv1830950994=11, srv1386779993=6, srv30519625=17, srv986941260=29, srv615893667=22, srv698077489=25, srv1010773339=0, srv1327990073=5, srv912334441=28, srv1821842926=10, srv1322974487=4, srv435237351=19, srv45691801=21, srv2086822781=16, srv1910164434=12, srv1136712353=1, srv156986168=8, srv69460954=24, srv1961269054=15, srv42449425=18, srv443063047=20, srv1796709674=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-29 05:55:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-29 05:55:36,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-29 05:55:36,606 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-29 05:55:36,607 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010773339:90 , srv1136712353:90 , srv11933409:90 , srv1268632515:90 , srv1322974487:90 , srv1327990073:90 , srv1386779993:90 , srv1405895405:90 , srv156986168:90 , srv1796709674:90 , srv1821842926:90 , srv1830950994:90 , srv1910164434:90 , srv1912132475:90 , srv1917594602:90 , srv1961269054:90 , srv2086822781:90 , srv30519625:90 , srv42449425:90 , srv435237351:90 , srv443063047:90 , srv45691801:90 , srv615893667:90 , srv654608882:90 , srv69460954:90 , srv698077489:90 , srv741876793:90 , srv887923839:90 , srv912334441:90 , srv986941260:90 }
2023-04-29 05:55:36,620 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 401), ProcessCount=170 (was 170), AvailableMemoryMB=11810 (was 11766) - AvailableMemoryMB LEAK? -