2023-02-25 00:53:59,687 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-25 00:54:00,069 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-25 00:54:00,188 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-25 00:54:00,266 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-25 00:54:00,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-25 00:54:00,288 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=170, AvailableMemoryMB=6510
2023-02-25 00:54:00,290 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-25 00:54:00,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-25 00:54:00,434 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007462893:84 , srv10565234:84 , srv1089221243:84 , srv114319079:84 , srv1157403318:84 , srv1161695566:84 , srv1181448861:84 , srv1202586070:84 , srv1269158700:84 , srv1285174943:84 , srv1309070926:84 , srv1318915051:84 , srv1360356597:84 , srv1363348743:84 , srv1381505341:84 , srv1393452831:84 , srv1416238409:84 , srv1446031130:84 , srv1465159867:84 , srv1480719738:84 , srv1494060580:84 , srv1552717071:84 , srv1552965938:84 , srv1567299183:84 , srv1592593758:84 , srv1594469022:84 , srv1598322198:84 , srv1619527661:84 , srv1631537891:84 , srv1652276456:84 , srv1684184115:84 , srv1700650739:84 , srv1708768135:84 , srv172758266:84 , srv1742599243:84 , srv1773272184:84 , srv1779882039:84 , srv1798510443:84 , srv1812146883:84 , srv1841807759:84 , srv1866664545:84 , srv1893666085:84 , srv1942876444:84 , srv1948687977:84 , srv1957452463:84 , srv1968738143:84 , srv1988857666:84 , srv1996148885:84 , srv2022632600:84 , srv2022810831:84 , srv2032131712:84 , srv2073829288:84 , srv2076056637:84 , srv2091873607:84 , srv211270859:84 , srv2133915471:84 , srv213671186:84 , srv246057050:84 , srv297989294:84 , srv308154176:84 , srv313845467:84 , srv341419854:84 , srv342356784:84 , srv353451726:84 , srv359898260:84 , srv361030933:84 , srv440091028:84 , srv468210928:84 , srv475833557:84 , srv479987165:84 , srv482985142:84 , srv483407427:84 , srv495982768:84 , srv503186040:84 , srv512687353:84 , srv55232039:84 , srv572120256:84 , srv582463765:84 , srv585842077:84 , srv603811361:84 , srv612775396:84 , srv623860174:84 , srv64501731:84 , srv673627924:84 , srv688637840:84 , srv694970344:84 , srv703505110:84 , srv704160452:84 , srv754204734:84 , srv755855593:84 , srv76678006:84 , srv768177453:84 , srv831169154:84 , srv856695916:84 , srv910432403:84 , srv934741660:84 , srv95768056:84 , srv984023807:84 , srv988892637:84 , srv1881664454:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-25 00:54:00,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:00,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:00,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:00,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:00,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:00,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:00,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:00,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:00,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:00,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:00,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:00,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:00,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:00,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:00,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:00,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:00,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:00,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:00,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:00,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:00,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:00,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:00,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:00,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:00,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:00,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:00,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:00,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:00,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:00,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:00,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:00,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:00,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:00,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:00,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:00,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:00,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:00,897 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-25 00:54:00,897 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-25 00:54:01,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 978 ms to try 5000 different iterations.  Found a solution that moves 4702 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1766425891341471. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04095566206453062, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055720965876045, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5224444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04095566206453062, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17133333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24341666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:01,611 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1269158700:82 , srv1360356597:82 , srv1652276456:82 , srv856695916:82 , srv1202586070:83 , srv1684184115:83 , srv1812146883:83 , srv2022810831:83 , srv246057050:83 , srv308154176:83 , srv341419854:83 , srv603811361:83 , srv704160452:83 , srv984023807:83 , srv1007462893:84 , srv1309070926:84 , srv1480719738:84 , srv172758266:84 , srv1996148885:84 , srv483407427:84 , srv623860174:84 , srv64501731:84 , srv755855593:84 , srv76678006:84 , srv934741660:84 , srv10565234:85 , srv114319079:85 , srv1494060580:85 , srv1552965938:85 , srv1841807759:85 , srv1948687977:85 , srv1968738143:85 , srv2091873607:85 , srv361030933:85 , srv468210928:85 , srv585842077:85 , srv1089221243:86 , srv1285174943:86 , srv1318915051:86 , srv1416238409:86 , srv1708768135:86 , srv1988857666:86 , srv2032131712:86 , srv313845467:86 , srv440091028:86 , srv479987165:86 , srv503186040:86 , srv512687353:86 , srv612775396:86 , srv688637840:86 , srv754204734:86 , srv768177453:86 , srv1157403318:87 , srv1181448861:87 , srv1363348743:87 , srv1446031130:87 , srv1465159867:87 , srv1567299183:87 , srv1594469022:87 , srv1631537891:87 , srv1700650739:87 , srv1742599243:87 , srv1779882039:87 , srv1798510443:87 , srv1893666085:87 , srv2022632600:87 , srv213671186:87 , srv297989294:87 , srv342356784:87 , srv482985142:87 , srv703505110:87 , srv1381505341:88 , srv1552717071:88 , srv1598322198:88 , srv1866664545:88 , srv1942876444:88 , srv1957452463:88 , srv211270859:88 , srv2133915471:88 , srv353451726:88 , srv359898260:88 , srv475833557:88 , srv495982768:88 , srv572120256:88 , srv582463765:88 , srv910432403:88 , srv1161695566:89 , srv1619527661:89 , srv1773272184:89 , srv2073829288:89 , srv2076056637:89 , srv55232039:89 , srv1393452831:90 , srv1592593758:90 , srv831169154:90 , srv95768056:90 , srv988892637:92 , srv673627924:97 , srv694970344:97 , srv1881664454:454 }
2023-02-25 00:54:01,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:01,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:01,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:01,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:01,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:01,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:01,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:01,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:01,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:01,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:01,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:01,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:01,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:01,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:01,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04095566206453062, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055720965876045, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04095566206453062, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17133333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24341666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:01,827 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-25 00:54:01,827 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17660966502644604, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04095566206453062, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055720965876045, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04095566206453062, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17133333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24341666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-25 00:54:02,157 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 474 ms to try 5000 different iterations.  Found a solution that moves 2700 regions; Going from a computed imbalance of 0.17660966502644604 to a new imbalance of 0.01632344755880785. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021272640939132417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032690776507860266, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021272640939132417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:02,166 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv673627924:75 , srv694970344:76 , srv988892637:79 , srv1598322198:81 , srv2073829288:81 , srv831169154:81 , srv1592593758:82 , srv2076056637:82 , srv703505110:82 , srv1157403318:83 , srv1393452831:83 , srv1779882039:83 , srv1942876444:83 , srv95768056:83 , srv1161695566:84 , srv1381505341:84 , srv1619527661:84 , srv1700650739:84 , srv1866664545:84 , srv211270859:84 , srv2133915471:84 , srv313845467:84 , srv353451726:84 , srv475833557:84 , srv482985142:84 , srv688637840:84 , srv1181448861:85 , srv1363348743:85 , srv1416238409:85 , srv1446031130:85 , srv1567299183:85 , srv1708768135:85 , srv1773272184:85 , srv1798510443:85 , srv1957452463:85 , srv1968738143:85 , srv2022632600:85 , srv2091873607:85 , srv213671186:85 , srv297989294:85 , srv359898260:85 , srv440091028:85 , srv495982768:85 , srv503186040:85 , srv55232039:85 , srv572120256:85 , srv582463765:85 , srv754204734:85 , srv910432403:85 , srv1318915051:86 , srv1494060580:86 , srv1552717071:86 , srv1631537891:86 , srv172758266:86 , srv1742599243:86 , srv1841807759:86 , srv1893666085:86 , srv1948687977:86 , srv468210928:86 , srv603811361:86 , srv612775396:86 , srv76678006:86 , srv10565234:87 , srv1089221243:87 , srv114319079:87 , srv1309070926:87 , srv1465159867:87 , srv1594469022:87 , srv1988857666:87 , srv1996148885:87 , srv342356784:87 , srv512687353:87 , srv585842077:87 , srv934741660:87 , srv1007462893:88 , srv1269158700:88 , srv1285174943:88 , srv1480719738:88 , srv1652276456:88 , srv361030933:88 , srv483407427:88 , srv768177453:88 , srv984023807:88 , srv1202586070:89 , srv1684184115:89 , srv2022810831:89 , srv2032131712:89 , srv308154176:89 , srv479987165:89 , srv623860174:89 , srv1360356597:90 , srv1552965938:90 , srv1812146883:90 , srv341419854:90 , srv64501731:90 , srv246057050:91 , srv704160452:92 , srv755855593:92 , srv856695916:92 , srv1881664454:509 }
2023-02-25 00:54:02,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:02,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:02,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:02,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:02,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:02,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:02,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:02,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:02,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:02,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:02,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:02,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:02,332 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021272640939132417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032690776507860266, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021272640939132417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:02,333 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-25 00:54:02,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016304541754725996, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021272640939132417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032690776507860266, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021272640939132417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-25 00:54:02,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 407 ms to try 5000 different iterations.  Found a solution that moves 1046 regions; Going from a computed imbalance of 0.016304541754725996 to a new imbalance of 5.790135040891636E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00713820595719384); MoveCostFunction : (multiplier=7.0, imbalance=0.11622222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:02,622 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2032131712:82 , srv704160452:82 , srv1552717071:83 , srv1552965938:83 , srv1594469022:83 , srv342356784:83 , srv479987165:83 , srv64501731:83 , srv755855593:83 , srv1089221243:84 , srv1202586070:84 , srv1285174943:84 , srv1465159867:84 , srv1631537891:84 , srv1742599243:84 , srv1773272184:84 , srv1798510443:84 , srv1957452463:84 , srv1988857666:84 , srv246057050:84 , srv341419854:84 , srv361030933:84 , srv512687353:84 , srv55232039:84 , srv694970344:84 , srv768177453:84 , srv856695916:84 , srv1007462893:85 , srv10565234:85 , srv114319079:85 , srv1161695566:85 , srv1181448861:85 , srv1360356597:85 , srv1363348743:85 , srv1393452831:85 , srv1567299183:85 , srv1592593758:85 , srv1619527661:85 , srv1812146883:85 , srv1866664545:85 , srv1893666085:85 , srv1942876444:85 , srv2022632600:85 , srv211270859:85 , srv2133915471:85 , srv213671186:85 , srv297989294:85 , srv359898260:85 , srv475833557:85 , srv495982768:85 , srv572120256:85 , srv582463765:85 , srv623860174:85 , srv673627924:85 , srv910432403:85 , srv1309070926:86 , srv1318915051:86 , srv1381505341:86 , srv1416238409:86 , srv1446031130:86 , srv1480719738:86 , srv1494060580:86 , srv1684184115:86 , srv1841807759:86 , srv1996148885:86 , srv2076056637:86 , srv308154176:86 , srv353451726:86 , srv483407427:86 , srv585842077:86 , srv612775396:86 , srv688637840:86 , srv754204734:86 , srv831169154:86 , srv934741660:86 , srv95768056:86 , srv984023807:86 , srv988892637:86 , srv1269158700:87 , srv1652276456:87 , srv1700650739:87 , srv1708768135:87 , srv172758266:87 , srv1779882039:87 , srv1948687977:87 , srv1968738143:87 , srv2022810831:87 , srv2073829288:87 , srv440091028:87 , srv468210928:87 , srv482985142:87 , srv503186040:87 , srv76678006:87 , srv1598322198:88 , srv313845467:88 , srv703505110:88 , srv1157403318:89 , srv2091873607:89 , srv603811361:89 , srv1881664454:549 }
2023-02-25 00:54:02,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:02,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:02,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:02,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:02,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:02,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:02,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:02,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:02,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:02,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:02,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:02,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:02,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:02,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:02,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:02,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00713820595719384); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:02,803 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-25 00:54:02,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.716892555448606E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00713820595719384); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-25 00:54:03,070 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 229 regions; Going from a computed imbalance of 5.716892555448606E-4 to a new imbalance of 2.7605020131514197E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.025444444444444443, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:03,072 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1161695566:83 , srv2022810831:83 , srv2091873607:83 , srv359898260:83 , srv755855593:83 , srv768177453:83 , srv95768056:83 , srv1007462893:84 , srv1157403318:84 , srv1285174943:84 , srv1318915051:84 , srv1393452831:84 , srv1446031130:84 , srv1465159867:84 , srv1480719738:84 , srv1552965938:84 , srv1619527661:84 , srv1684184115:84 , srv1700650739:84 , srv1708768135:84 , srv1773272184:84 , srv1812146883:84 , srv1841807759:84 , srv1893666085:84 , srv1948687977:84 , srv246057050:84 , srv308154176:84 , srv313845467:84 , srv353451726:84 , srv440091028:84 , srv468210928:84 , srv479987165:84 , srv482985142:84 , srv483407427:84 , srv495982768:84 , srv503186040:84 , srv55232039:84 , srv572120256:84 , srv582463765:84 , srv585842077:84 , srv603811361:84 , srv612775396:84 , srv623860174:84 , srv856695916:84 , srv910432403:84 , srv10565234:85 , srv1089221243:85 , srv114319079:85 , srv1181448861:85 , srv1269158700:85 , srv1309070926:85 , srv1363348743:85 , srv1381505341:85 , srv1416238409:85 , srv1552717071:85 , srv1567299183:85 , srv1592593758:85 , srv1594469022:85 , srv1598322198:85 , srv1631537891:85 , srv1652276456:85 , srv172758266:85 , srv1742599243:85 , srv1779882039:85 , srv1866664545:85 , srv1957452463:85 , srv1968738143:85 , srv1988857666:85 , srv2022632600:85 , srv2032131712:85 , srv2073829288:85 , srv2076056637:85 , srv211270859:85 , srv2133915471:85 , srv213671186:85 , srv297989294:85 , srv341419854:85 , srv342356784:85 , srv361030933:85 , srv475833557:85 , srv512687353:85 , srv64501731:85 , srv673627924:85 , srv694970344:85 , srv703505110:85 , srv704160452:85 , srv754204734:85 , srv76678006:85 , srv831169154:85 , srv934741660:85 , srv984023807:85 , srv988892637:85 , srv1202586070:86 , srv1360356597:86 , srv1494060580:86 , srv1798510443:86 , srv1942876444:86 , srv1996148885:86 , srv688637840:86 , srv1881664454:630 }
2023-02-25 00:54:03,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:03,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:03,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:03,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:03,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:03,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:03,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:03,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:03,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:03,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:03,204 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-25 00:54:03,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.600152785938665E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0020651563939657444); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-25 00:54:03,417 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 311 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 2.600152785938665E-5 to a new imbalance of 7.248293037828088E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:03,418 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1157403318:83 , srv1360356597:83 , srv1381505341:83 , srv1494060580:83 , srv1996148885:83 , srv10565234:84 , srv1089221243:84 , srv114319079:84 , srv1181448861:84 , srv1202586070:84 , srv1269158700:84 , srv1285174943:84 , srv1309070926:84 , srv1318915051:84 , srv1363348743:84 , srv1393452831:84 , srv1416238409:84 , srv1446031130:84 , srv1465159867:84 , srv1480719738:84 , srv1552717071:84 , srv1552965938:84 , srv1567299183:84 , srv1592593758:84 , srv1594469022:84 , srv1598322198:84 , srv1619527661:84 , srv1631537891:84 , srv1652276456:84 , srv1684184115:84 , srv1700650739:84 , srv1708768135:84 , srv172758266:84 , srv1742599243:84 , srv1773272184:84 , srv1779882039:84 , srv1798510443:84 , srv1812146883:84 , srv1866664545:84 , srv1893666085:84 , srv1942876444:84 , srv1948687977:84 , srv1957452463:84 , srv1968738143:84 , srv1988857666:84 , srv2022632600:84 , srv2022810831:84 , srv2032131712:84 , srv2073829288:84 , srv2076056637:84 , srv2091873607:84 , srv211270859:84 , srv2133915471:84 , srv213671186:84 , srv246057050:84 , srv297989294:84 , srv308154176:84 , srv313845467:84 , srv341419854:84 , srv342356784:84 , srv353451726:84 , srv361030933:84 , srv440091028:84 , srv468210928:84 , srv475833557:84 , srv479987165:84 , srv482985142:84 , srv483407427:84 , srv495982768:84 , srv503186040:84 , srv512687353:84 , srv55232039:84 , srv572120256:84 , srv582463765:84 , srv585842077:84 , srv603811361:84 , srv612775396:84 , srv623860174:84 , srv64501731:84 , srv673627924:84 , srv688637840:84 , srv694970344:84 , srv703505110:84 , srv704160452:84 , srv754204734:84 , srv755855593:84 , srv76678006:84 , srv831169154:84 , srv856695916:84 , srv910432403:84 , srv934741660:84 , srv95768056:84 , srv984023807:84 , srv988892637:84 , srv1007462893:85 , srv1161695566:85 , srv1841807759:85 , srv359898260:85 , srv768177453:85 , srv1881664454:684 }
2023-02-25 00:54:03,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:03,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv55232039=76, srv1285174943=9, srv1161695566=5, srv856695916=94, srv213671186=57, srv572120256=77, srv1269158700=8, srv768177453=92, srv1866664545=40, srv1841807759=39, srv2073829288=52, srv1567299183=23, srv342356784=63, srv1594469022=25, srv172758266=33, srv1446031130=17, srv308154176=60, srv1652276456=29, srv2133915471=56, srv361030933=66, srv495982768=73, srv1592593758=24, srv1465159867=18, srv64501731=83, srv482985142=71, srv1480719738=19, srv754204734=89, srv479987165=70, srv1598322198=26, srv2022810831=50, srv1893666085=42, srv831169154=93, srv1318915051=11, srv1552965938=22, srv623860174=82, srv1181448861=6, srv1988857666=47, srv1552717071=21, srv612775396=81, srv1779882039=36, srv910432403=95, srv1157403318=4, srv988892637=99, srv468210928=68, srv10565234=1, srv673627924=84, srv1708768135=32, srv353451726=64, srv1957452463=45, srv1798510443=37, srv1881664454=41, srv1942876444=43, srv1202586070=7, srv582463765=78, srv1812146883=38, srv934741660=96, srv2032131712=51, srv1363348743=13, srv475833557=69, srv1309070926=10, srv297989294=59, srv1996148885=48, srv1773272184=35, srv341419854=62, srv503186040=74, srv512687353=75, srv704160452=88, srv1631537891=28, srv440091028=67, srv1416238409=16, srv359898260=65, srv2022632600=49, srv95768056=97, srv1007462893=0, srv246057050=58, srv1089221243=2, srv2091873607=54, srv313845467=61, srv1393452831=15, srv483407427=72, srv1494060580=20, srv703505110=87, srv984023807=98, srv1684184115=30, srv1742599243=34, srv2076056637=53, srv1360356597=12, srv211270859=55, srv1381505341=14, srv114319079=3, srv688637840=85, srv603811361=80, srv1700650739=31, srv76678006=91, srv585842077=79, srv694970344=86, srv1619527661=27, srv1968738143=46, srv755855593=90, srv1948687977=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:03,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-25 00:54:03,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-25 00:54:03,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-25 00:54:03,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-25 00:54:03,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-25 00:54:03,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-25 00:54:03,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-25 00:54:03,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-25 00:54:03,547 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:03,547 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1157403318:83 , srv1360356597:83 , srv1381505341:83 , srv1494060580:83 , srv1996148885:83 , srv10565234:84 , srv1089221243:84 , srv114319079:84 , srv1181448861:84 , srv1202586070:84 , srv1269158700:84 , srv1285174943:84 , srv1309070926:84 , srv1318915051:84 , srv1363348743:84 , srv1393452831:84 , srv1416238409:84 , srv1446031130:84 , srv1465159867:84 , srv1480719738:84 , srv1552717071:84 , srv1552965938:84 , srv1567299183:84 , srv1592593758:84 , srv1594469022:84 , srv1598322198:84 , srv1619527661:84 , srv1631537891:84 , srv1652276456:84 , srv1684184115:84 , srv1700650739:84 , srv1708768135:84 , srv172758266:84 , srv1742599243:84 , srv1773272184:84 , srv1779882039:84 , srv1798510443:84 , srv1812146883:84 , srv1866664545:84 , srv1893666085:84 , srv1942876444:84 , srv1948687977:84 , srv1957452463:84 , srv1968738143:84 , srv1988857666:84 , srv2022632600:84 , srv2022810831:84 , srv2032131712:84 , srv2073829288:84 , srv2076056637:84 , srv2091873607:84 , srv211270859:84 , srv2133915471:84 , srv213671186:84 , srv246057050:84 , srv297989294:84 , srv308154176:84 , srv313845467:84 , srv341419854:84 , srv342356784:84 , srv353451726:84 , srv361030933:84 , srv440091028:84 , srv468210928:84 , srv475833557:84 , srv479987165:84 , srv482985142:84 , srv483407427:84 , srv495982768:84 , srv503186040:84 , srv512687353:84 , srv55232039:84 , srv572120256:84 , srv582463765:84 , srv585842077:84 , srv603811361:84 , srv612775396:84 , srv623860174:84 , srv64501731:84 , srv673627924:84 , srv688637840:84 , srv694970344:84 , srv703505110:84 , srv704160452:84 , srv754204734:84 , srv755855593:84 , srv76678006:84 , srv831169154:84 , srv856695916:84 , srv910432403:84 , srv934741660:84 , srv95768056:84 , srv984023807:84 , srv988892637:84 , srv1007462893:85 , srv1161695566:85 , srv1841807759:85 , srv359898260:85 , srv768177453:85 , srv1881664454:684 }
2023-02-25 00:54:03,575 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 331), ProcessCount=170 (was 170), AvailableMemoryMB=5978 (was 6510)
2023-02-25 00:54:03,584 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=170, AvailableMemoryMB=5978
2023-02-25 00:54:03,584 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-25 00:54:03,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-25 00:54:03,592 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1020285468:84 , srv1137931307:84 , srv1141162752:84 , srv1184123732:84 , srv11845565:84 , srv1223764595:84 , srv1458045623:84 , srv1460087883:84 , srv1662299365:84 , srv1675247843:84 , srv1722320478:84 , srv1783850984:84 , srv1832703063:84 , srv1908092847:84 , srv1963988442:84 , srv2021668982:84 , srv2062498821:84 , srv2081532601:84 , srv2136027449:84 , srv239321935:84 , srv27207459:84 , srv272916302:84 , srv310688097:84 , srv419355509:84 , srv435337185:84 , srv529537368:84 , srv607987261:84 , srv664899317:84 , srv793530848:84 , srv694024916:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-25 00:54:03,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:54:03,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv27207459=20, srv1223764595=5, srv272916302=21, srv2062498821=16, srv1963988442=14, srv607987261=26, srv1783850984=11, srv1020285468=0, srv1458045623=6, srv1722320478=10, srv11845565=4, srv1141162752=2, srv419355509=23, srv1662299365=8, srv1908092847=13, srv529537368=25, srv1460087883=7, srv664899317=27, srv1832703063=12, srv2081532601=17, srv310688097=22, srv435337185=24, srv793530848=29, srv1675247843=9, srv239321935=19, srv694024916=28, srv1184123732=3, srv1137931307=1, srv2021668982=15, srv2136027449=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:54:03,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:54:03,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-25 00:54:03,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0985867173299755, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:54:03,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912503686791434, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0985867173299755, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-25 00:56:03,606 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6695857 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912503686791434 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:56:03,613 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1020285468:90 , srv1137931307:90 , srv1141162752:90 , srv1184123732:90 , srv11845565:90 , srv1223764595:90 , srv1458045623:90 , srv1460087883:90 , srv1662299365:90 , srv1675247843:90 , srv1722320478:90 , srv1783850984:90 , srv1832703063:90 , srv1908092847:90 , srv1963988442:90 , srv2021668982:90 , srv2062498821:90 , srv2081532601:90 , srv2136027449:90 , srv239321935:90 , srv27207459:90 , srv272916302:90 , srv310688097:90 , srv419355509:90 , srv435337185:90 , srv529537368:90 , srv607987261:90 , srv664899317:90 , srv694024916:90 , srv793530848:90 }
2023-02-25 00:56:03,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-25 00:56:03,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv27207459=20, srv1223764595=5, srv272916302=21, srv2062498821=16, srv1963988442=14, srv607987261=26, srv1783850984=11, srv1020285468=0, srv1458045623=6, srv1722320478=10, srv11845565=4, srv1141162752=2, srv419355509=23, srv1662299365=8, srv1908092847=13, srv529537368=25, srv1460087883=7, srv664899317=27, srv1832703063=12, srv2081532601=17, srv310688097=22, srv435337185=24, srv793530848=29, srv1675247843=9, srv239321935=19, srv694024916=28, srv1184123732=3, srv1137931307=1, srv2021668982=15, srv2136027449=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-25 00:56:03,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-25 00:56:03,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-25 00:56:03,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-25 00:56:03,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-25 00:56:03,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-25 00:56:03,636 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1020285468:90 , srv1137931307:90 , srv1141162752:90 , srv1184123732:90 , srv11845565:90 , srv1223764595:90 , srv1458045623:90 , srv1460087883:90 , srv1662299365:90 , srv1675247843:90 , srv1722320478:90 , srv1783850984:90 , srv1832703063:90 , srv1908092847:90 , srv1963988442:90 , srv2021668982:90 , srv2062498821:90 , srv2081532601:90 , srv2136027449:90 , srv239321935:90 , srv27207459:90 , srv272916302:90 , srv310688097:90 , srv419355509:90 , srv435337185:90 , srv529537368:90 , srv607987261:90 , srv664899317:90 , srv694024916:90 , srv793530848:90 }
2023-02-25 00:56:03,648 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 331), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=5710 (was 5978)