2023-03-18 20:54:02,568 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-18 20:54:02,875 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-18 20:54:02,981 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-18 20:54:03,044 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-18 20:54:03,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-18 20:54:03,064 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=169, AvailableMemoryMB=2964
2023-03-18 20:54:03,066 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-18 20:54:03,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-18 20:54:03,191 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011091441:84 , srv1020288922:84 , srv1024788867:84 , srv1033099408:84 , srv1041218133:84 , srv1089737369:84 , srv112507255:84 , srv1130323903:84 , srv1162460567:84 , srv1168812957:84 , srv1177599035:84 , srv1188366060:84 , srv1193029487:84 , srv1210270402:84 , srv1212099377:84 , srv1242002524:84 , srv12578107:84 , srv1270471547:84 , srv1301878260:84 , srv1313587584:84 , srv1314907955:84 , srv1330091485:84 , srv1348770237:84 , srv1350100236:84 , srv1372626169:84 , srv1400297845:84 , srv1401234634:84 , srv1402746040:84 , srv1426441744:84 , srv1454106984:84 , srv1502494000:84 , srv1529376769:84 , srv1537681474:84 , srv1567639981:84 , srv157733948:84 , srv1580220666:84 , srv1611525426:84 , srv1639716402:84 , srv1646264325:84 , srv1657311720:84 , srv1712794697:84 , srv1725717088:84 , srv1737784551:84 , srv1745037088:84 , srv1755613232:84 , srv1756273479:84 , srv1787300119:84 , srv1800057487:84 , srv1822066674:84 , srv1859386814:84 , srv1861206286:84 , srv1865627540:84 , srv1875729124:84 , srv1903363386:84 , srv1915420157:84 , srv1925146636:84 , srv208838004:84 , srv2098695334:84 , srv218409745:84 , srv227839141:84 , srv251494553:84 , srv267530552:84 , srv280025221:84 , srv302511994:84 , srv367877325:84 , srv38335695:84 , srv413379591:84 , srv419657913:84 , srv438541142:84 , srv442498109:84 , srv444907173:84 , srv44686424:84 , srv477360754:84 , srv483538840:84 , srv490339249:84 , srv524746643:84 , srv544082241:84 , srv561433205:84 , srv583108565:84 , srv584968618:84 , srv58722192:84 , srv599143832:84 , srv6144584:84 , srv617880790:84 , srv686429382:84 , srv691263773:84 , srv698347072:84 , srv716679810:84 , srv721328796:84 , srv750707861:84 , srv773943531:84 , srv78927298:84 , srv822731606:84 , srv827366522:84 , srv844706298:84 , srv852451147:84 , srv880675599:84 , srv882595467:84 , srv907048370:84 , srv284387184:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-18 20:54:03,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:03,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:03,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:03,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:03,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:03,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:03,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:03,299 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:03,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:03,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:03,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:03,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:03,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:03,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:03,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:03,479 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:03,479 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-18 20:54:03,480 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-18 20:54:03,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 494 ms to try 5000 different iterations.  Found a solution that moves 4654 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18271162459534931. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04126869425275468, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057054525282565056, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5171111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04126869425275468, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:03,827 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1400297845:82 , srv1454106984:82 , srv1502494000:82 , srv1712794697:82 , srv302511994:82 , srv1011091441:83 , srv1725717088:83 , srv1861206286:83 , srv477360754:83 , srv686429382:83 , srv880675599:83 , srv1033099408:84 , srv1350100236:84 , srv157733948:84 , srv1580220666:84 , srv1657311720:84 , srv280025221:84 , srv524746643:84 , srv583108565:84 , srv584968618:84 , srv773943531:84 , srv827366522:84 , srv844706298:84 , srv1089737369:85 , srv112507255:85 , srv1130323903:85 , srv12578107:85 , srv1270471547:85 , srv1529376769:85 , srv1567639981:85 , srv1756273479:85 , srv1875729124:85 , srv1925146636:85 , srv419657913:85 , srv442498109:85 , srv44686424:85 , srv907048370:85 , srv1041218133:86 , srv1210270402:86 , srv1212099377:86 , srv1242002524:86 , srv1330091485:86 , srv1348770237:86 , srv1745037088:86 , srv1787300119:86 , srv1903363386:86 , srv218409745:86 , srv267530552:86 , srv413379591:86 , srv438541142:86 , srv483538840:86 , srv58722192:86 , srv6144584:86 , srv698347072:86 , srv1020288922:87 , srv1024788867:87 , srv1168812957:87 , srv1177599035:87 , srv1188366060:87 , srv1314907955:87 , srv1372626169:87 , srv1611525426:87 , srv1800057487:87 , srv1822066674:87 , srv1865627540:87 , srv2098695334:87 , srv227839141:87 , srv38335695:87 , srv599143832:87 , srv617880790:87 , srv691263773:87 , srv721328796:87 , srv1402746040:88 , srv1426441744:88 , srv1537681474:88 , srv1646264325:88 , srv251494553:88 , srv367877325:88 , srv444907173:88 , srv78927298:88 , srv852451147:88 , srv1639716402:89 , srv1755613232:89 , srv208838004:89 , srv490339249:89 , srv544082241:89 , srv561433205:89 , srv716679810:89 , srv822731606:89 , srv882595467:89 , srv1301878260:90 , srv1401234634:90 , srv1915420157:90 , srv750707861:90 , srv1162460567:91 , srv1313587584:91 , srv1737784551:91 , srv1859386814:91 , srv1193029487:92 , srv284387184:457 }
2023-03-18 20:54:03,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:03,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:03,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:03,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:03,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:03,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:03,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:03,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:03,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:03,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:03,968 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04126869425275468, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057054525282565056, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04126869425275468, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:03,968 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-18 20:54:03,968 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18267903659083193, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04126869425275468, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057054525282565056, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04126869425275468, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-18 20:54:04,274 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 406 ms to try 5000 different iterations.  Found a solution that moves 2680 regions; Going from a computed imbalance of 0.18267903659083193 to a new imbalance of 0.015018942641867788. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022170534726323774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03862682261544118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29777777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022170534726323774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:04,285 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1859386814:80 , srv1162460567:81 , srv1193029487:81 , srv1401234634:81 , srv1639716402:81 , srv251494553:81 , srv1313587584:82 , srv1737784551:82 , srv490339249:82 , srv750707861:82 , srv1188366060:83 , srv1301878260:83 , srv1402746040:83 , srv1915420157:83 , srv544082241:83 , srv716679810:83 , srv78927298:83 , srv1024788867:84 , srv1168812957:84 , srv1314907955:84 , srv1372626169:84 , srv1426441744:84 , srv1800057487:84 , srv267530552:84 , srv413379591:84 , srv44686424:84 , srv691263773:84 , srv822731606:84 , srv852451147:84 , srv1020288922:85 , srv1041218133:85 , srv1089737369:85 , srv1242002524:85 , srv1537681474:85 , srv1567639981:85 , srv1611525426:85 , srv1745037088:85 , srv1822066674:85 , srv1903363386:85 , srv218409745:85 , srv227839141:85 , srv438541142:85 , srv444907173:85 , srv483538840:85 , srv561433205:85 , srv599143832:85 , srv698347072:85 , srv721328796:85 , srv112507255:86 , srv1130323903:86 , srv1212099377:86 , srv12578107:86 , srv1270471547:86 , srv1330091485:86 , srv1348770237:86 , srv1646264325:86 , srv1875729124:86 , srv280025221:86 , srv367877325:86 , srv58722192:86 , srv617880790:86 , srv773943531:86 , srv844706298:86 , srv1177599035:87 , srv157733948:87 , srv1580220666:87 , srv1755613232:87 , srv1756273479:87 , srv1787300119:87 , srv1865627540:87 , srv1925146636:87 , srv2098695334:87 , srv38335695:87 , srv442498109:87 , srv524746643:87 , srv6144584:87 , srv827366522:87 , srv882595467:87 , srv907048370:87 , srv1210270402:88 , srv1350100236:88 , srv1657311720:88 , srv1861206286:88 , srv477360754:88 , srv1033099408:89 , srv1529376769:89 , srv208838004:89 , srv419657913:89 , srv583108565:89 , srv584968618:89 , srv1011091441:90 , srv1400297845:90 , srv1454106984:90 , srv1712794697:90 , srv1725717088:90 , srv686429382:90 , srv880675599:90 , srv1502494000:91 , srv302511994:92 , srv284387184:514 }
2023-03-18 20:54:04,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:04,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:04,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:04,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:04,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:04,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:04,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:04,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:04,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:04,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:04,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:04,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:04,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:04,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:04,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:04,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:04,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:04,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:04,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:04,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:04,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:04,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022170534726323774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03862682261544118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022170534726323774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:04,446 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-18 20:54:04,446 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015000176880779134, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022170534726323774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03862682261544118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022170534726323774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-18 20:54:04,673 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 984 regions; Going from a computed imbalance of 0.015000176880779134 to a new imbalance of 6.035282787348338E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0057551139715074735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008054249284545283); MoveCostFunction : (multiplier=7.0, imbalance=0.10933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0057551139715074735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:04,675 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv208838004:79 , srv1755613232:82 , srv882595467:82 , srv1529376769:83 , srv1865627540:83 , srv302511994:83 , srv367877325:83 , srv419657913:83 , srv561433205:83 , srv584968618:83 , srv1011091441:84 , srv1033099408:84 , srv1177599035:84 , srv1193029487:84 , srv1210270402:84 , srv1301878260:84 , srv1537681474:84 , srv1646264325:84 , srv2098695334:84 , srv38335695:84 , srv583108565:84 , srv6144584:84 , srv617880790:84 , srv822731606:84 , srv1020288922:85 , srv1162460567:85 , srv1212099377:85 , srv1313587584:85 , srv1400297845:85 , srv1426441744:85 , srv1454106984:85 , srv1502494000:85 , srv1657311720:85 , srv1712794697:85 , srv1725717088:85 , srv1737784551:85 , srv1756273479:85 , srv1787300119:85 , srv1915420157:85 , srv1925146636:85 , srv227839141:85 , srv444907173:85 , srv599143832:85 , srv686429382:85 , srv716679810:85 , srv721328796:85 , srv750707861:85 , srv907048370:85 , srv1041218133:86 , srv1130323903:86 , srv1168812957:86 , srv1330091485:86 , srv1348770237:86 , srv1350100236:86 , srv1401234634:86 , srv157733948:86 , srv1580220666:86 , srv1611525426:86 , srv1822066674:86 , srv1875729124:86 , srv1903363386:86 , srv442498109:86 , srv483538840:86 , srv490339249:86 , srv544082241:86 , srv58722192:86 , srv698347072:86 , srv852451147:86 , srv880675599:86 , srv1024788867:87 , srv1089737369:87 , srv112507255:87 , srv1188366060:87 , srv1242002524:87 , srv12578107:87 , srv1270471547:87 , srv1314907955:87 , srv1372626169:87 , srv1402746040:87 , srv1639716402:87 , srv1745037088:87 , srv1800057487:87 , srv1859386814:87 , srv1861206286:87 , srv218409745:87 , srv413379591:87 , srv438541142:87 , srv477360754:87 , srv524746643:87 , srv691263773:87 , srv773943531:87 , srv78927298:87 , srv827366522:87 , srv844706298:87 , srv1567639981:88 , srv267530552:88 , srv280025221:88 , srv44686424:88 , srv251494553:89 , srv284387184:538 }
2023-03-18 20:54:04,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:04,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:04,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:04,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:04,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:04,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:04,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:04,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:04,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:04,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0057551139715074735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008054249284545283); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0057551139715074735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:04,800 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-18 20:54:04,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.966381634694473E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0057551139715074735); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008054249284545283); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0057551139715074735); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-18 20:54:05,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 251 regions; Going from a computed imbalance of 5.966381634694473E-4 to a new imbalance of 2.845114131749511E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.02788888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:05,132 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1350100236:83 , srv880675599:83 , srv1024788867:84 , srv1162460567:84 , srv1177599035:84 , srv1188366060:84 , srv1210270402:84 , srv1212099377:84 , srv1242002524:84 , srv12578107:84 , srv1270471547:84 , srv1313587584:84 , srv1314907955:84 , srv1330091485:84 , srv1348770237:84 , srv1372626169:84 , srv1402746040:84 , srv1502494000:84 , srv1567639981:84 , srv1611525426:84 , srv1657311720:84 , srv1737784551:84 , srv1745037088:84 , srv1755613232:84 , srv1787300119:84 , srv1800057487:84 , srv1822066674:84 , srv1859386814:84 , srv1915420157:84 , srv2098695334:84 , srv218409745:84 , srv251494553:84 , srv267530552:84 , srv280025221:84 , srv38335695:84 , srv438541142:84 , srv442498109:84 , srv444907173:84 , srv524746643:84 , srv544082241:84 , srv58722192:84 , srv6144584:84 , srv686429382:84 , srv691263773:84 , srv698347072:84 , srv78927298:84 , srv827366522:84 , srv882595467:84 , srv907048370:84 , srv1020288922:85 , srv1033099408:85 , srv1041218133:85 , srv1089737369:85 , srv112507255:85 , srv1130323903:85 , srv1168812957:85 , srv1193029487:85 , srv1301878260:85 , srv1400297845:85 , srv1401234634:85 , srv1426441744:85 , srv1454106984:85 , srv1529376769:85 , srv1537681474:85 , srv157733948:85 , srv1580220666:85 , srv1639716402:85 , srv1646264325:85 , srv1712794697:85 , srv1725717088:85 , srv1756273479:85 , srv1861206286:85 , srv1865627540:85 , srv1875729124:85 , srv1925146636:85 , srv208838004:85 , srv227839141:85 , srv302511994:85 , srv367877325:85 , srv413379591:85 , srv419657913:85 , srv44686424:85 , srv477360754:85 , srv483538840:85 , srv490339249:85 , srv561433205:85 , srv583108565:85 , srv599143832:85 , srv617880790:85 , srv716679810:85 , srv721328796:85 , srv750707861:85 , srv773943531:85 , srv822731606:85 , srv844706298:85 , srv852451147:85 , srv1011091441:86 , srv1903363386:86 , srv584968618:86 , srv284387184:633 }
2023-03-18 20:54:05,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:05,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:05,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:05,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:05,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:05,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:05,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:05,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:05,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:05,268 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-18 20:54:05,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6693601752848763E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-18 20:54:05,492 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.6693601752848763E-5 to a new imbalance of 8.926231082857762E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:05,492 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011091441:83 , srv112507255:83 , srv1646264325:83 , srv1725717088:83 , srv1861206286:83 , srv1903363386:83 , srv477360754:83 , srv852451147:83 , srv1020288922:84 , srv1024788867:84 , srv1033099408:84 , srv1041218133:84 , srv1089737369:84 , srv1130323903:84 , srv1168812957:84 , srv1177599035:84 , srv1193029487:84 , srv1210270402:84 , srv1242002524:84 , srv12578107:84 , srv1270471547:84 , srv1301878260:84 , srv1313587584:84 , srv1314907955:84 , srv1330091485:84 , srv1348770237:84 , srv1372626169:84 , srv1400297845:84 , srv1401234634:84 , srv1402746040:84 , srv1426441744:84 , srv1454106984:84 , srv1502494000:84 , srv1529376769:84 , srv1537681474:84 , srv1567639981:84 , srv157733948:84 , srv1580220666:84 , srv1611525426:84 , srv1639716402:84 , srv1712794697:84 , srv1737784551:84 , srv1745037088:84 , srv1755613232:84 , srv1756273479:84 , srv1787300119:84 , srv1800057487:84 , srv1822066674:84 , srv1859386814:84 , srv1865627540:84 , srv1875729124:84 , srv1915420157:84 , srv1925146636:84 , srv208838004:84 , srv2098695334:84 , srv218409745:84 , srv227839141:84 , srv251494553:84 , srv267530552:84 , srv280025221:84 , srv302511994:84 , srv367877325:84 , srv38335695:84 , srv413379591:84 , srv419657913:84 , srv438541142:84 , srv442498109:84 , srv444907173:84 , srv44686424:84 , srv483538840:84 , srv490339249:84 , srv524746643:84 , srv544082241:84 , srv561433205:84 , srv583108565:84 , srv584968618:84 , srv58722192:84 , srv599143832:84 , srv617880790:84 , srv686429382:84 , srv691263773:84 , srv716679810:84 , srv721328796:84 , srv750707861:84 , srv773943531:84 , srv78927298:84 , srv822731606:84 , srv827366522:84 , srv844706298:84 , srv880675599:84 , srv882595467:84 , srv1162460567:85 , srv1188366060:85 , srv1212099377:85 , srv1350100236:85 , srv1657311720:85 , srv6144584:85 , srv698347072:85 , srv907048370:85 , srv284387184:684 }
2023-03-18 20:54:05,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:05,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv822731606=93, srv1193029487=12, srv1372626169=24, srv1657311720=39, srv1400297845=25, srv1529376769=31, srv1350100236=23, srv1567639981=33, srv490339249=75, srv1822066674=48, srv617880790=84, srv251494553=60, srv544082241=77, srv12578107=16, srv1314907955=20, srv483538840=74, srv1270471547=17, srv78927298=92, srv880675599=97, srv1024788867=2, srv1646264325=38, srv267530552=61, srv1242002524=15, srv691263773=86, srv698347072=87, srv1301878260=18, srv1454106984=29, srv524746643=76, srv844706298=95, srv284387184=63, srv907048370=99, srv1011091441=0, srv218409745=58, srv1875729124=52, srv38335695=66, srv584968618=80, srv1915420157=54, srv716679810=88, srv1401234634=26, srv1745037088=43, srv2098695334=57, srv44686424=72, srv852451147=96, srv1755613232=44, srv1188366060=11, srv208838004=56, srv227839141=59, srv721328796=89, srv367877325=65, srv438541142=69, srv1787300119=46, srv773943531=91, srv1210270402=13, srv1737784551=42, srv1537681474=32, srv882595467=98, srv444907173=71, srv1168812957=9, srv1033099408=3, srv1348770237=22, srv112507255=6, srv1712794697=40, srv477360754=73, srv1177599035=10, srv1502494000=30, srv1089737369=5, srv1725717088=41, srv750707861=90, srv1020288922=1, srv1402746040=27, srv1903363386=53, srv1212099377=14, srv280025221=62, srv1756273479=45, srv1800057487=47, srv599143832=82, srv827366522=94, srv1130323903=7, srv1859386814=49, srv1925146636=55, srv1313587584=19, srv583108565=79, srv413379591=67, srv1426441744=28, srv1162460567=8, srv1861206286=50, srv1041218133=4, srv6144584=83, srv1865627540=51, srv561433205=78, srv1330091485=21, srv419657913=68, srv58722192=81, srv1611525426=36, srv1580220666=35, srv157733948=34, srv442498109=70, srv302511994=64, srv686429382=85, srv1639716402=37} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:05,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:05,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-18 20:54:05,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-18 20:54:05,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-18 20:54:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-18 20:54:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-18 20:54:05,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.793190239318795E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:05,622 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1011091441:83 , srv112507255:83 , srv1646264325:83 , srv1725717088:83 , srv1861206286:83 , srv1903363386:83 , srv477360754:83 , srv852451147:83 , srv1020288922:84 , srv1024788867:84 , srv1033099408:84 , srv1041218133:84 , srv1089737369:84 , srv1130323903:84 , srv1168812957:84 , srv1177599035:84 , srv1193029487:84 , srv1210270402:84 , srv1242002524:84 , srv12578107:84 , srv1270471547:84 , srv1301878260:84 , srv1313587584:84 , srv1314907955:84 , srv1330091485:84 , srv1348770237:84 , srv1372626169:84 , srv1400297845:84 , srv1401234634:84 , srv1402746040:84 , srv1426441744:84 , srv1454106984:84 , srv1502494000:84 , srv1529376769:84 , srv1537681474:84 , srv1567639981:84 , srv157733948:84 , srv1580220666:84 , srv1611525426:84 , srv1639716402:84 , srv1712794697:84 , srv1737784551:84 , srv1745037088:84 , srv1755613232:84 , srv1756273479:84 , srv1787300119:84 , srv1800057487:84 , srv1822066674:84 , srv1859386814:84 , srv1865627540:84 , srv1875729124:84 , srv1915420157:84 , srv1925146636:84 , srv208838004:84 , srv2098695334:84 , srv218409745:84 , srv227839141:84 , srv251494553:84 , srv267530552:84 , srv280025221:84 , srv302511994:84 , srv367877325:84 , srv38335695:84 , srv413379591:84 , srv419657913:84 , srv438541142:84 , srv442498109:84 , srv444907173:84 , srv44686424:84 , srv483538840:84 , srv490339249:84 , srv524746643:84 , srv544082241:84 , srv561433205:84 , srv583108565:84 , srv584968618:84 , srv58722192:84 , srv599143832:84 , srv617880790:84 , srv686429382:84 , srv691263773:84 , srv716679810:84 , srv721328796:84 , srv750707861:84 , srv773943531:84 , srv78927298:84 , srv822731606:84 , srv827366522:84 , srv844706298:84 , srv880675599:84 , srv882595467:84 , srv1162460567:85 , srv1188366060:85 , srv1212099377:85 , srv1350100236:85 , srv1657311720:85 , srv6144584:85 , srv698347072:85 , srv907048370:85 , srv284387184:684 }
2023-03-18 20:54:05,649 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 311), ProcessCount=169 (was 169), AvailableMemoryMB=2471 (was 2964)
2023-03-18 20:54:05,658 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=169, AvailableMemoryMB=2471
2023-03-18 20:54:05,658 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-18 20:54:05,659 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-18 20:54:05,669 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv102332847:84 , srv1040215226:84 , srv12350150:84 , srv1292648231:84 , srv1328887481:84 , srv1341094578:84 , srv1439318321:84 , srv1439522647:84 , srv147882974:84 , srv1545298452:84 , srv1554796984:84 , srv163259486:84 , srv1791187687:84 , srv1807890203:84 , srv18831581:84 , srv190265020:84 , srv2074377467:84 , srv2141943965:84 , srv229005112:84 , srv331945452:84 , srv466102991:84 , srv469885351:84 , srv522229810:84 , srv537448466:84 , srv58863736:84 , srv732500675:84 , srv787359736:84 , srv819166868:84 , srv991291538:84 , srv170484614:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-18 20:54:05,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:54:05,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1292648231=3, srv12350150=2, srv1341094578=5, srv190265020=16, srv58863736=25, srv147882974=8, srv1807890203=14, srv732500675=26, srv1554796984=10, srv2074377467=17, srv170484614=12, srv18831581=15, srv537448466=24, srv1439318321=6, srv466102991=21, srv522229810=23, srv331945452=20, srv1439522647=7, srv1328887481=4, srv1791187687=13, srv229005112=19, srv2141943965=18, srv1545298452=9, srv102332847=0, srv819166868=28, srv991291538=29, srv1040215226=1, srv787359736=27, srv163259486=11, srv469885351=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:54:05,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:54:05,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:54:05,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-18 20:54:05,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.12135696245537, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:54:05,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912575435090307, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.12135696245537, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-18 20:56:05,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6168244 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912575435090307 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:56:05,697 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv102332847:90 , srv1040215226:90 , srv12350150:90 , srv1292648231:90 , srv1328887481:90 , srv1341094578:90 , srv1439318321:90 , srv1439522647:90 , srv147882974:90 , srv1545298452:90 , srv1554796984:90 , srv163259486:90 , srv170484614:90 , srv1791187687:90 , srv1807890203:90 , srv18831581:90 , srv190265020:90 , srv2074377467:90 , srv2141943965:90 , srv229005112:90 , srv331945452:90 , srv466102991:90 , srv469885351:90 , srv522229810:90 , srv537448466:90 , srv58863736:90 , srv732500675:90 , srv787359736:90 , srv819166868:90 , srv991291538:90 }
2023-03-18 20:56:05,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-18 20:56:05,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1292648231=3, srv12350150=2, srv1341094578=5, srv190265020=16, srv58863736=25, srv147882974=8, srv1807890203=14, srv732500675=26, srv1554796984=10, srv2074377467=17, srv170484614=12, srv18831581=15, srv537448466=24, srv1439318321=6, srv466102991=21, srv522229810=23, srv331945452=20, srv1439522647=7, srv1328887481=4, srv1791187687=13, srv229005112=19, srv2141943965=18, srv1545298452=9, srv102332847=0, srv819166868=28, srv991291538=29, srv1040215226=1, srv787359736=27, srv163259486=11, srv469885351=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-18 20:56:05,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-18 20:56:05,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-18 20:56:05,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-18 20:56:05,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-18 20:56:05,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-18 20:56:05,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-18 20:56:05,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-18 20:56:05,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-18 20:56:05,714 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-18 20:56:05,714 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv102332847:90 , srv1040215226:90 , srv12350150:90 , srv1292648231:90 , srv1328887481:90 , srv1341094578:90 , srv1439318321:90 , srv1439522647:90 , srv147882974:90 , srv1545298452:90 , srv1554796984:90 , srv163259486:90 , srv170484614:90 , srv1791187687:90 , srv1807890203:90 , srv18831581:90 , srv190265020:90 , srv2074377467:90 , srv2141943965:90 , srv229005112:90 , srv331945452:90 , srv466102991:90 , srv469885351:90 , srv522229810:90 , srv537448466:90 , srv58863736:90 , srv732500675:90 , srv787359736:90 , srv819166868:90 , srv991291538:90 }
2023-03-18 20:56:05,726 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 311), ProcessCount=169 (was 169), AvailableMemoryMB=2066 (was 2471)