2023-04-05 05:00:53,959 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-05 05:00:54,272 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-05 05:00:54,371 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-05 05:00:54,429 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 05:00:54,436 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 05:00:54,446 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=166, AvailableMemoryMB=8128
2023-04-05 05:00:54,448 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 05:00:54,448 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 05:00:54,574 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1072972951:84 , srv107898796:84 , srv1092283700:84 , srv1097355648:84 , srv1097957919:84 , srv110906565:84 , srv1113859087:84 , srv1115745491:84 , srv1124255039:84 , srv1141633955:84 , srv1172307397:84 , srv1189661461:84 , srv119802660:84 , srv1229614564:84 , srv1260056435:84 , srv1263170967:84 , srv1264101996:84 , srv1293583258:84 , srv1297721651:84 , srv1315359517:84 , srv1372295605:84 , srv139660298:84 , srv1397494171:84 , srv140184380:84 , srv1434578411:84 , srv1475559643:84 , srv1493255326:84 , srv1497586316:84 , srv1535200397:84 , srv1577433535:84 , srv162494293:84 , srv1624960762:84 , srv1690972212:84 , srv1704937147:84 , srv1709118878:84 , srv1730315859:84 , srv175316040:84 , srv1784089940:84 , srv1797405042:84 , srv1826929302:84 , srv1880829730:84 , srv1964197688:84 , srv1970585909:84 , srv1991701867:84 , srv1998120305:84 , srv2000294995:84 , srv2009744051:84 , srv2015027203:84 , srv2018954256:84 , srv205914648:84 , srv2076105374:84 , srv2088143480:84 , srv2126933151:84 , srv220061600:84 , srv241985798:84 , srv252114801:84 , srv272935367:84 , srv276815845:84 , srv28130548:84 , srv293709545:84 , srv31375184:84 , srv326414689:84 , srv345707649:84 , srv387226430:84 , srv397451885:84 , srv401584260:84 , srv40373399:84 , srv408571148:84 , srv413724253:84 , srv489354126:84 , srv497364459:84 , srv51209272:84 , srv531513553:84 , srv552070451:84 , srv609231009:84 , srv67067249:84 , srv715872763:84 , srv716823292:84 , srv749363068:84 , srv76603208:84 , srv766934676:84 , srv774658334:84 , srv786091335:84 , srv80606424:84 , srv807482177:84 , srv819897052:84 , srv821568867:84 , srv825414080:84 , srv82601472:84 , srv835792252:84 , srv849377549:84 , srv854271513:84 , srv892638216:84 , srv906101583:84 , srv912991247:84 , srv916606336:84 , srv952696365:84 , srv963767640:84 , srv984969994:84 , srv216266536:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-05 05:00:54,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:54,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:54,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:54,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:54,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:54,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:54,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:54,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:54,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:54,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:54,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:54,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:54,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:54,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:54,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:54,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:54,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:54,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:54,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:54,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:54,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:54,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:54,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:54,884 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 05:00:54,885 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 05:00:55,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 732 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17901249934611926. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041839782533125744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05795621242733654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041839782533125744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23958333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:55,477 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1124255039:81 , srv140184380:81 , srv1797405042:82 , srv1998120305:82 , srv220061600:82 , srv1092283700:83 , srv1172307397:83 , srv1497586316:83 , srv408571148:83 , srv531513553:83 , srv716823292:83 , srv80606424:83 , srv916606336:83 , srv1115745491:84 , srv1141633955:84 , srv1263170967:84 , srv1297721651:84 , srv1493255326:84 , srv1624960762:84 , srv1690972212:84 , srv1880829730:84 , srv2076105374:84 , srv276815845:84 , srv497364459:84 , srv51209272:84 , srv76603208:84 , srv1097957919:85 , srv110906565:85 , srv1293583258:85 , srv139660298:85 , srv162494293:85 , srv1704937147:85 , srv175316040:85 , srv2009744051:85 , srv552070451:85 , srv749363068:85 , srv825414080:85 , srv1097355648:86 , srv1189661461:86 , srv119802660:86 , srv1260056435:86 , srv1397494171:86 , srv1475559643:86 , srv1826929302:86 , srv1991701867:86 , srv2000294995:86 , srv2088143480:86 , srv2126933151:86 , srv387226430:86 , srv67067249:86 , srv786091335:86 , srv821568867:86 , srv849377549:86 , srv107898796:87 , srv1113859087:87 , srv1535200397:87 , srv1730315859:87 , srv1784089940:87 , srv272935367:87 , srv28130548:87 , srv31375184:87 , srv326414689:87 , srv401584260:87 , srv40373399:87 , srv489354126:87 , srv854271513:87 , srv906101583:87 , srv963767640:87 , srv984969994:87 , srv1072972951:88 , srv1229614564:88 , srv1315359517:88 , srv1372295605:88 , srv1577433535:88 , srv1709118878:88 , srv2018954256:88 , srv345707649:88 , srv413724253:88 , srv609231009:88 , srv715872763:88 , srv774658334:88 , srv807482177:88 , srv819897052:88 , srv835792252:88 , srv912991247:88 , srv952696365:88 , srv1264101996:89 , srv2015027203:89 , srv241985798:89 , srv252114801:89 , srv293709545:89 , srv1434578411:90 , srv1964197688:90 , srv82601472:90 , srv397451885:91 , srv766934676:91 , srv892638216:91 , srv1970585909:92 , srv205914648:95 , srv216266536:462 }
2023-04-05 05:00:55,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:55,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:55,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:55,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:55,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:55,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:55,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:55,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:55,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:55,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:55,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:55,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:55,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:55,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:55,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:55,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:55,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:55,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041839782533125744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05795621242733654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041839782533125744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23958333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:55,703 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 05:00:55,703 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17897970827926174, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041839782533125744, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05795621242733654, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041839782533125744, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17433333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23958333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 05:00:55,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 375 ms to try 5000 different iterations.  Found a solution that moves 2644 regions; Going from a computed imbalance of 0.17897970827926174 to a new imbalance of 0.015068514311989358. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03636083041923899, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2937777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:55,925 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv205914648:76 , srv1970585909:79 , srv984969994:80 , srv1264101996:81 , srv766934676:81 , srv82601472:81 , srv107898796:82 , srv1229614564:82 , srv2015027203:82 , srv241985798:82 , srv293709545:82 , srv397451885:82 , srv892638216:82 , srv1315359517:83 , srv1434578411:83 , srv1964197688:83 , srv272935367:83 , srv345707649:83 , srv1072972951:84 , srv1097355648:84 , srv110906565:84 , srv1372295605:84 , srv1493255326:84 , srv1784089940:84 , srv2018954256:84 , srv252114801:84 , srv31375184:84 , srv413724253:84 , srv774658334:84 , srv807482177:84 , srv835792252:84 , srv952696365:84 , srv1535200397:85 , srv1577433535:85 , srv2000294995:85 , srv2126933151:85 , srv326414689:85 , srv387226430:85 , srv40373399:85 , srv497364459:85 , srv609231009:85 , srv715872763:85 , srv819897052:85 , srv849377549:85 , srv854271513:85 , srv912991247:85 , srv1097957919:86 , srv1113859087:86 , srv1189661461:86 , srv119802660:86 , srv1260056435:86 , srv1397494171:86 , srv1475559643:86 , srv1624960762:86 , srv1730315859:86 , srv1991701867:86 , srv2088143480:86 , srv401584260:86 , srv552070451:86 , srv67067249:86 , srv1263170967:87 , srv1297721651:87 , srv162494293:87 , srv1690972212:87 , srv1704937147:87 , srv1709118878:87 , srv1826929302:87 , srv2009744051:87 , srv28130548:87 , srv489354126:87 , srv786091335:87 , srv906101583:87 , srv1092283700:88 , srv1141633955:88 , srv1172307397:88 , srv1293583258:88 , srv139660298:88 , srv1880829730:88 , srv1998120305:88 , srv276815845:88 , srv531513553:88 , srv821568867:88 , srv916606336:88 , srv963767640:88 , srv175316040:89 , srv2076105374:89 , srv51209272:89 , srv749363068:89 , srv825414080:89 , srv1115745491:90 , srv220061600:90 , srv408571148:90 , srv76603208:90 , srv80606424:90 , srv1124255039:91 , srv140184380:91 , srv1797405042:92 , srv716823292:92 , srv1497586316:93 , srv216266536:509 }
2023-04-05 05:00:55,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:55,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:55,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:55,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:55,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:55,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:55,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:55,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:55,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:55,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:55,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:55,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:55,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:55,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:56,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03636083041923899, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,062 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 05:00:56,063 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015050000628288462, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03636083041923899, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04666666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 05:00:56,243 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 285 ms to try 5000 different iterations.  Found a solution that moves 1038 regions; Going from a computed imbalance of 0.015050000628288462 to a new imbalance of 7.648018376121634E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006106262743597928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00842208629724276); MoveCostFunction : (multiplier=7.0, imbalance=0.11533333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006106262743597928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,245 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1497586316:80 , srv1709118878:82 , srv1797405042:83 , srv28130548:83 , srv716823292:83 , srv749363068:83 , srv821568867:83 , srv825414080:83 , srv963767640:83 , srv1115745491:84 , srv1293583258:84 , srv1577433535:84 , srv1730315859:84 , srv175316040:84 , srv1826929302:84 , srv2076105374:84 , srv401584260:84 , srv408571148:84 , srv489354126:84 , srv51209272:84 , srv715872763:84 , srv76603208:84 , srv80606424:84 , srv906101583:84 , srv912991247:84 , srv1072972951:85 , srv1113859087:85 , srv1124255039:85 , srv1141633955:85 , srv119802660:85 , srv1260056435:85 , srv1263170967:85 , srv139660298:85 , srv140184380:85 , srv1434578411:85 , srv1475559643:85 , srv1704937147:85 , srv1880829730:85 , srv1964197688:85 , srv2088143480:85 , srv276815845:85 , srv397451885:85 , srv609231009:85 , srv766934676:85 , srv774658334:85 , srv786091335:85 , srv807482177:85 , srv835792252:85 , srv854271513:85 , srv892638216:85 , srv1097957919:86 , srv1189661461:86 , srv1297721651:86 , srv1315359517:86 , srv1397494171:86 , srv1535200397:86 , srv162494293:86 , srv1690972212:86 , srv1784089940:86 , srv1970585909:86 , srv1991701867:86 , srv2009744051:86 , srv2018954256:86 , srv205914648:86 , srv2126933151:86 , srv220061600:86 , srv241985798:86 , srv293709545:86 , srv326414689:86 , srv345707649:86 , srv40373399:86 , srv413724253:86 , srv531513553:86 , srv552070451:86 , srv67067249:86 , srv819897052:86 , srv952696365:86 , srv1092283700:87 , srv1097355648:87 , srv1172307397:87 , srv1229614564:87 , srv1264101996:87 , srv1372295605:87 , srv1624960762:87 , srv2000294995:87 , srv2015027203:87 , srv272935367:87 , srv31375184:87 , srv387226430:87 , srv82601472:87 , srv849377549:87 , srv916606336:87 , srv107898796:88 , srv110906565:88 , srv1998120305:88 , srv252114801:88 , srv497364459:88 , srv1493255326:90 , srv984969994:90 , srv216266536:541 }
2023-04-05 05:00:56,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:56,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:56,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:56,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:56,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:56,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:56,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:56,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:56,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:56,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:56,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:56,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:56,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:56,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:56,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:56,369 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006106262743597928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00842208629724276); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006106262743597928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,369 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 05:00:56,369 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.575336062651399E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006106262743597928); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00842208629724276); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006106262743597928); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 05:00:56,559 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 272 ms to try 5000 different iterations.  Found a solution that moves 308 regions; Going from a computed imbalance of 7.575336062651399E-4 to a new imbalance of 2.8980770654051747E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,560 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv252114801:81 , srv1372295605:83 , srv819897052:83 , srv1092283700:84 , srv1097957919:84 , srv110906565:84 , srv1113859087:84 , srv1115745491:84 , srv1141633955:84 , srv1172307397:84 , srv1264101996:84 , srv139660298:84 , srv1493255326:84 , srv1535200397:84 , srv162494293:84 , srv175316040:84 , srv1784089940:84 , srv1964197688:84 , srv1998120305:84 , srv2000294995:84 , srv2009744051:84 , srv2015027203:84 , srv2018954256:84 , srv2126933151:84 , srv220061600:84 , srv31375184:84 , srv326414689:84 , srv387226430:84 , srv397451885:84 , srv40373399:84 , srv413724253:84 , srv489354126:84 , srv609231009:84 , srv67067249:84 , srv716823292:84 , srv76603208:84 , srv82601472:84 , srv835792252:84 , srv849377549:84 , srv892638216:84 , srv906101583:84 , srv916606336:84 , srv952696365:84 , srv963767640:84 , srv984969994:84 , srv1072972951:85 , srv107898796:85 , srv1097355648:85 , srv1124255039:85 , srv1189661461:85 , srv1229614564:85 , srv1260056435:85 , srv1293583258:85 , srv1297721651:85 , srv1315359517:85 , srv1397494171:85 , srv1434578411:85 , srv1475559643:85 , srv1577433535:85 , srv1624960762:85 , srv1690972212:85 , srv1704937147:85 , srv1709118878:85 , srv1730315859:85 , srv1797405042:85 , srv1826929302:85 , srv1880829730:85 , srv1970585909:85 , srv1991701867:85 , srv205914648:85 , srv2076105374:85 , srv241985798:85 , srv272935367:85 , srv276815845:85 , srv28130548:85 , srv293709545:85 , srv345707649:85 , srv401584260:85 , srv408571148:85 , srv497364459:85 , srv51209272:85 , srv531513553:85 , srv552070451:85 , srv715872763:85 , srv749363068:85 , srv766934676:85 , srv774658334:85 , srv786091335:85 , srv80606424:85 , srv807482177:85 , srv821568867:85 , srv854271513:85 , srv912991247:85 , srv119802660:86 , srv1263170967:86 , srv140184380:86 , srv1497586316:86 , srv2088143480:86 , srv825414080:86 , srv216266536:629 }
2023-04-05 05:00:56,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:56,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:56,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:56,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:56,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:56,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:56,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:56,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:56,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:56,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:56,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,664 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 05:00:56,664 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6824108558788504E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 05:00:56,797 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 203 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.6824108558788504E-5 to a new imbalance of 8.16874815785912E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,797 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1189661461:83 , srv119802660:83 , srv1397494171:83 , srv140184380:83 , srv1434578411:83 , srv1991701867:83 , srv2088143480:83 , srv786091335:83 , srv825414080:83 , srv1072972951:84 , srv107898796:84 , srv1092283700:84 , srv1097355648:84 , srv1113859087:84 , srv1115745491:84 , srv1124255039:84 , srv1172307397:84 , srv1229614564:84 , srv1260056435:84 , srv1263170967:84 , srv1293583258:84 , srv1297721651:84 , srv1315359517:84 , srv1372295605:84 , srv139660298:84 , srv1475559643:84 , srv1493255326:84 , srv1497586316:84 , srv1535200397:84 , srv1577433535:84 , srv162494293:84 , srv1624960762:84 , srv1690972212:84 , srv1704937147:84 , srv1709118878:84 , srv1730315859:84 , srv175316040:84 , srv1797405042:84 , srv1826929302:84 , srv1880829730:84 , srv1964197688:84 , srv1970585909:84 , srv1998120305:84 , srv2000294995:84 , srv2009744051:84 , srv2015027203:84 , srv2018954256:84 , srv205914648:84 , srv2076105374:84 , srv220061600:84 , srv241985798:84 , srv252114801:84 , srv272935367:84 , srv276815845:84 , srv28130548:84 , srv293709545:84 , srv31375184:84 , srv326414689:84 , srv345707649:84 , srv387226430:84 , srv397451885:84 , srv401584260:84 , srv40373399:84 , srv408571148:84 , srv413724253:84 , srv489354126:84 , srv497364459:84 , srv51209272:84 , srv531513553:84 , srv552070451:84 , srv609231009:84 , srv67067249:84 , srv715872763:84 , srv716823292:84 , srv749363068:84 , srv76603208:84 , srv766934676:84 , srv774658334:84 , srv80606424:84 , srv807482177:84 , srv819897052:84 , srv821568867:84 , srv82601472:84 , srv849377549:84 , srv854271513:84 , srv892638216:84 , srv906101583:84 , srv912991247:84 , srv916606336:84 , srv952696365:84 , srv963767640:84 , srv1097957919:85 , srv110906565:85 , srv1141633955:85 , srv1264101996:85 , srv1784089940:85 , srv2126933151:85 , srv835792252:85 , srv984969994:85 , srv216266536:685 }
2023-04-05 05:00:56,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:56,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv786091335=83, srv821568867=87, srv1880829730=40, srv1264101996=16, srv1704937147=33, srv2000294995=45, srv963767640=98, srv1730315859=35, srv715872763=77, srv1690972212=32, srv1497586316=27, srv1964197688=41, srv1434578411=24, srv205914648=49, srv1072972951=0, srv1189661461=11, srv609231009=75, srv825414080=88, srv76603208=80, srv51209272=72, srv1293583258=17, srv220061600=54, srv252114801=56, srv1624960762=31, srv912991247=95, srv326414689=62, srv2018954256=48, srv40373399=67, srv552070451=74, srv1229614564=13, srv80606424=84, srv397451885=65, srv916606336=96, srv1577433535=29, srv1475559643=25, srv1172307397=10, srv67067249=76, srv716823292=78, srv2076105374=50, srv401584260=66, srv119802660=12, srv82601472=89, srv1124255039=8, srv1092283700=2, srv1998120305=44, srv139660298=21, srv2088143480=51, srv1991701867=43, srv110906565=5, srv1970585909=42, srv774658334=82, srv819897052=86, srv241985798=55, srv413724253=69, srv107898796=1, srv2015027203=47, srv1709118878=34, srv1097957919=4, srv849377549=91, srv1141633955=9, srv387226430=64, srv1493255326=26, srv489354126=70, srv766934676=81, srv1397494171=22, srv906101583=94, srv140184380=23, srv1784089940=37, srv276815845=58, srv31375184=61, srv854271513=92, srv1315359517=19, srv1826929302=39, srv807482177=85, srv2126933151=52, srv1297721651=18, srv531513553=73, srv216266536=53, srv952696365=97, srv272935367=57, srv835792252=90, srv1097355648=3, srv1115745491=7, srv1260056435=14, srv497364459=71, srv1372295605=20, srv1113859087=6, srv293709545=60, srv408571148=68, srv1263170967=15, srv1797405042=38, srv2009744051=46, srv749363068=79, srv984969994=99, srv1535200397=28, srv162494293=30, srv892638216=93, srv175316040=36, srv345707649=63, srv28130548=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:56,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:56,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 05:00:56,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 05:00:56,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 05:00:56,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 05:00:56,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 05:00:56,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 05:00:56,895 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,895 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1189661461:83 , srv119802660:83 , srv1397494171:83 , srv140184380:83 , srv1434578411:83 , srv1991701867:83 , srv2088143480:83 , srv786091335:83 , srv825414080:83 , srv1072972951:84 , srv107898796:84 , srv1092283700:84 , srv1097355648:84 , srv1113859087:84 , srv1115745491:84 , srv1124255039:84 , srv1172307397:84 , srv1229614564:84 , srv1260056435:84 , srv1263170967:84 , srv1293583258:84 , srv1297721651:84 , srv1315359517:84 , srv1372295605:84 , srv139660298:84 , srv1475559643:84 , srv1493255326:84 , srv1497586316:84 , srv1535200397:84 , srv1577433535:84 , srv162494293:84 , srv1624960762:84 , srv1690972212:84 , srv1704937147:84 , srv1709118878:84 , srv1730315859:84 , srv175316040:84 , srv1797405042:84 , srv1826929302:84 , srv1880829730:84 , srv1964197688:84 , srv1970585909:84 , srv1998120305:84 , srv2000294995:84 , srv2009744051:84 , srv2015027203:84 , srv2018954256:84 , srv205914648:84 , srv2076105374:84 , srv220061600:84 , srv241985798:84 , srv252114801:84 , srv272935367:84 , srv276815845:84 , srv28130548:84 , srv293709545:84 , srv31375184:84 , srv326414689:84 , srv345707649:84 , srv387226430:84 , srv397451885:84 , srv401584260:84 , srv40373399:84 , srv408571148:84 , srv413724253:84 , srv489354126:84 , srv497364459:84 , srv51209272:84 , srv531513553:84 , srv552070451:84 , srv609231009:84 , srv67067249:84 , srv715872763:84 , srv716823292:84 , srv749363068:84 , srv76603208:84 , srv766934676:84 , srv774658334:84 , srv80606424:84 , srv807482177:84 , srv819897052:84 , srv821568867:84 , srv82601472:84 , srv849377549:84 , srv854271513:84 , srv892638216:84 , srv906101583:84 , srv912991247:84 , srv916606336:84 , srv952696365:84 , srv963767640:84 , srv1097957919:85 , srv110906565:85 , srv1141633955:85 , srv1264101996:85 , srv1784089940:85 , srv2126933151:85 , srv835792252:85 , srv984969994:85 , srv216266536:685 }
2023-04-05 05:00:56,914 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 279) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=7608 (was 8128)
2023-04-05 05:00:56,920 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=166, AvailableMemoryMB=7608
2023-04-05 05:00:56,921 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 05:00:56,921 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-05 05:00:56,930 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1124446344:84 , srv113086285:84 , srv1156540095:84 , srv1173666116:84 , srv1236576431:84 , srv1255201340:84 , srv1256344359:84 , srv1288070909:84 , srv1331902390:84 , srv1367803605:84 , srv1467173855:84 , srv1467705605:84 , srv1589362126:84 , srv1631362759:84 , srv1706992935:84 , srv1814253866:84 , srv1824839540:84 , srv1850110148:84 , srv1998027863:84 , srv2033195200:84 , srv2103774812:84 , srv243141039:84 , srv271406089:84 , srv382353588:84 , srv399770464:84 , srv457457478:84 , srv756014350:84 , srv886410085:84 , srv918716897:84 , srv1698093700:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-05 05:00:56,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:00:56,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1706992935=15, srv1288070909=7, srv1256344359=6, srv457457478=26, srv1850110148=18, srv756014350=27, srv243141039=22, srv1467173855=10, srv1173666116=3, srv1824839540=17, srv886410085=28, srv113086285=1, srv918716897=29, srv2103774812=21, srv399770464=25, srv1631362759=13, srv271406089=23, srv1331902390=8, srv1698093700=14, srv1124446344=0, srv1367803605=9, srv1998027863=19, srv1156540095=2, srv1255201340=5, srv1236576431=4, srv1814253866=16, srv2033195200=20, srv1589362126=12, srv382353588=24, srv1467705605=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:00:56,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:00:56,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:00:56,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:00:56,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 05:00:56,956 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1571824696566082, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:00:56,956 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912688320093687, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1571824696566082, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-05 05:02:56,946 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 10018489 different iterations.  Found a solution that moves 1842 regions; Going from a computed imbalance of 0.9912688320093687 to a new imbalance of 4.2993198912066E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:02:56,951 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1124446344:90 , srv113086285:90 , srv1156540095:90 , srv1173666116:90 , srv1236576431:90 , srv1255201340:90 , srv1256344359:90 , srv1288070909:90 , srv1331902390:90 , srv1367803605:90 , srv1467173855:90 , srv1467705605:90 , srv1589362126:90 , srv1631362759:90 , srv1698093700:90 , srv1706992935:90 , srv1814253866:90 , srv1824839540:90 , srv1850110148:90 , srv1998027863:90 , srv2033195200:90 , srv2103774812:90 , srv243141039:90 , srv271406089:90 , srv382353588:90 , srv399770464:90 , srv457457478:90 , srv756014350:90 , srv886410085:90 , srv918716897:90 }
2023-04-05 05:02:56,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 05:02:56,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1706992935=15, srv1288070909=7, srv1256344359=6, srv457457478=26, srv1850110148=18, srv756014350=27, srv243141039=22, srv1467173855=10, srv1173666116=3, srv1824839540=17, srv886410085=28, srv113086285=1, srv918716897=29, srv2103774812=21, srv399770464=25, srv1631362759=13, srv271406089=23, srv1331902390=8, srv1698093700=14, srv1124446344=0, srv1367803605=9, srv1998027863=19, srv1156540095=2, srv1255201340=5, srv1236576431=4, srv1814253866=16, srv2033195200=20, srv1589362126=12, srv382353588=24, srv1467705605=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 05:02:56,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 05:02:56,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 05:02:56,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 05:02:56,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 05:02:56,967 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1124446344:90 , srv113086285:90 , srv1156540095:90 , srv1173666116:90 , srv1236576431:90 , srv1255201340:90 , srv1256344359:90 , srv1288070909:90 , srv1331902390:90 , srv1367803605:90 , srv1467173855:90 , srv1467705605:90 , srv1589362126:90 , srv1631362759:90 , srv1698093700:90 , srv1706992935:90 , srv1814253866:90 , srv1824839540:90 , srv1850110148:90 , srv1998027863:90 , srv2033195200:90 , srv2103774812:90 , srv243141039:90 , srv271406089:90 , srv382353588:90 , srv399770464:90 , srv457457478:90 , srv756014350:90 , srv886410085:90 , srv918716897:90 }
2023-04-05 05:02:56,977 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 337), ProcessCount=165 (was 166), AvailableMemoryMB=7491 (was 7608)