2024-04-04 07:53:15,878 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-04 07:53:16,224 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-04 07:53:16,348 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-04 07:53:16,418 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-04 07:53:16,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-04 07:53:16,445 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=170, AvailableMemoryMB=7795
2024-04-04 07:53:16,447 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-04 07:53:16,448 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-04 07:53:16,581 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004430696:84 , srv1045582566:84 , srv108848335:84 , srv1099962731:84 , srv1105470631:84 , srv1122211945:84 , srv1126137521:84 , srv1139123512:84 , srv1156650518:84 , srv1170463775:84 , srv1172087455:84 , srv1211485581:84 , srv1250557334:84 , srv1253573556:84 , srv1266642660:84 , srv1298756333:84 , srv1349574899:84 , srv1357349700:84 , srv1387024109:84 , srv1393485513:84 , srv1396976188:84 , srv1405919120:84 , srv1406543651:84 , srv1420315885:84 , srv1517325424:84 , srv1521900402:84 , srv156386445:84 , srv157872147:84 , srv1582482324:84 , srv1584480506:84 , srv1628799284:84 , srv1633275020:84 , srv1635906814:84 , srv1670938841:84 , srv1673881680:84 , srv1677947637:84 , srv1678023081:84 , srv1761620149:84 , srv1763278771:84 , srv1766669139:84 , srv1825744078:84 , srv1832005045:84 , srv184984496:84 , srv1898158083:84 , srv1907323615:84 , srv1996425134:84 , srv2005378914:84 , srv200621208:84 , srv2030934209:84 , srv2050480257:84 , srv2070340685:84 , srv2086626661:84 , srv209210532:84 , srv2110658933:84 , srv2112199847:84 , srv2123994676:84 , srv2136250875:84 , srv243215662:84 , srv246018550:84 , srv273108591:84 , srv278348345:84 , srv307949328:84 , srv33198222:84 , srv33225300:84 , srv355225014:84 , srv376121313:84 , srv387404454:84 , srv40694778:84 , srv430512978:84 , srv476596173:84 , srv490758159:84 , srv516895204:84 , srv540175033:84 , srv587729861:84 , srv599024465:84 , srv604175077:84 , srv607911933:84 , srv660682784:84 , srv677681235:84 , srv704183411:84 , srv720743357:84 , srv726819777:84 , srv731324567:84 , srv74527010:84 , srv773518629:84 , srv787551291:84 , srv793420545:84 , srv802550830:84 , srv847519359:84 , srv847718605:84 , srv872840276:84 , srv888769919:84 , srv899277298:84 , srv936351798:84 , srv944935093:84 , srv948909291:84 , srv957285703:84 , srv989892699:84 , srv991931239:84 , srv947797088:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-04 07:53:16,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:16,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:16,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:16,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:16,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:16,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:16,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:16,701 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:16,702 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:16,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:16,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:16,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:16,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:17,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:17,036 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-04 07:53:17,037 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-04 07:53:17,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 779 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1818492487290132. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03915206762804572, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05938706756096364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03915206762804572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17708333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:17,530 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1521900402:81 , srv387404454:82 , srv899277298:82 , srv957285703:82 , srv1122211945:83 , srv1156650518:83 , srv1996425134:83 , srv2136250875:83 , srv246018550:83 , srv540175033:83 , srv587729861:83 , srv948909291:83 , srv991931239:83 , srv1045582566:84 , srv1126137521:84 , srv1517325424:84 , srv40694778:84 , srv847519359:84 , srv1099962731:85 , srv1139123512:85 , srv1211485581:85 , srv1253573556:85 , srv1298756333:85 , srv1405919120:85 , srv1633275020:85 , srv1677947637:85 , srv1763278771:85 , srv2005378914:85 , srv2110658933:85 , srv307949328:85 , srv490758159:85 , srv604175077:85 , srv607911933:85 , srv773518629:85 , srv872840276:85 , srv888769919:85 , srv936351798:85 , srv1105470631:86 , srv1250557334:86 , srv1387024109:86 , srv1406543651:86 , srv1420315885:86 , srv157872147:86 , srv1673881680:86 , srv2086626661:86 , srv2123994676:86 , srv430512978:86 , srv74527010:86 , srv1266642660:87 , srv1349574899:87 , srv1357349700:87 , srv1582482324:87 , srv1670938841:87 , srv1766669139:87 , srv1825744078:87 , srv184984496:87 , srv1898158083:87 , srv200621208:87 , srv2050480257:87 , srv2070340685:87 , srv33198222:87 , srv376121313:87 , srv476596173:87 , srv599024465:87 , srv677681235:87 , srv720743357:87 , srv787551291:87 , srv793420545:87 , srv802550830:87 , srv847718605:87 , srv1635906814:88 , srv1832005045:88 , srv209210532:88 , srv2112199847:88 , srv273108591:88 , srv33225300:88 , srv516895204:88 , srv704183411:88 , srv1004430696:89 , srv108848335:89 , srv1170463775:89 , srv1172087455:89 , srv1393485513:89 , srv1396976188:89 , srv1678023081:89 , srv1761620149:89 , srv1907323615:89 , srv2030934209:89 , srv731324567:89 , srv944935093:89 , srv1628799284:90 , srv243215662:90 , srv278348345:90 , srv355225014:90 , srv726819777:91 , srv989892699:91 , srv660682784:92 , srv156386445:93 , srv1584480506:94 , srv947797088:438 }
2024-04-04 07:53:17,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:17,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:17,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:17,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:17,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:17,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:17,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:17,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:17,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:17,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:17,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:17,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:17,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:17,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:17,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:17,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:17,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:17,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:17,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:17,788 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03915206762804572, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05938706756096364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03915206762804572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17708333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:17,788 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-04 07:53:17,788 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1818165766986999, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03915206762804572, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05938706756096364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03915206762804572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17708333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24366666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-04 07:53:18,141 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 542 ms to try 5000 different iterations.  Found a solution that moves 2662 regions; Going from a computed imbalance of 0.1818165766986999 to a new imbalance of 0.016526493800940394. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026003731254514263, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04279515585622627, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29577777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.026003731254514263, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:18,154 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1584480506:78 , srv660682784:78 , srv278348345:79 , srv355225014:79 , srv108848335:80 , srv1628799284:80 , srv1172087455:81 , srv156386445:81 , srv1678023081:81 , srv1761620149:81 , srv273108591:81 , srv74527010:81 , srv1004430696:82 , srv1357349700:82 , srv1898158083:82 , srv2030934209:82 , srv2086626661:82 , srv243215662:82 , srv476596173:82 , srv726819777:82 , srv944935093:82 , srv989892699:82 , srv1170463775:83 , srv1393485513:83 , srv1825744078:83 , srv2070340685:83 , srv209210532:83 , srv2112199847:83 , srv307949328:83 , srv33198222:83 , srv33225300:83 , srv599024465:83 , srv731324567:83 , srv802550830:83 , srv1420315885:84 , srv1670938841:84 , srv1907323615:84 , srv2110658933:84 , srv704183411:84 , srv793420545:84 , srv888769919:84 , srv1105470631:85 , srv1396976188:85 , srv1582482324:85 , srv1635906814:85 , srv1673881680:85 , srv1763278771:85 , srv1766669139:85 , srv1832005045:85 , srv2050480257:85 , srv720743357:85 , srv787551291:85 , srv1139123512:86 , srv1266642660:86 , srv1406543651:86 , srv157872147:86 , srv1677947637:86 , srv184984496:86 , srv2005378914:86 , srv2123994676:86 , srv246018550:86 , srv376121313:86 , srv430512978:86 , srv490758159:86 , srv677681235:86 , srv847718605:86 , srv936351798:86 , srv1156650518:87 , srv1211485581:87 , srv1250557334:87 , srv1253573556:87 , srv1349574899:87 , srv1517325424:87 , srv1633275020:87 , srv516895204:87 , srv773518629:87 , srv1099962731:88 , srv1126137521:88 , srv1387024109:88 , srv200621208:88 , srv540175033:88 , srv604175077:88 , srv607911933:88 , srv872840276:88 , srv1045582566:89 , srv387404454:89 , srv40694778:89 , srv948909291:89 , srv1298756333:90 , srv1405919120:90 , srv1996425134:90 , srv899277298:90 , srv957285703:90 , srv991931239:90 , srv2136250875:91 , srv1122211945:92 , srv587729861:92 , srv847519359:92 , srv1521900402:94 , srv947797088:567 }
2024-04-04 07:53:18,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:18,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:18,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:18,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:18,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:18,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:18,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:18,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:18,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:18,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:18,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:18,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026003731254514263, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04279515585622627, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.026003731254514263, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:18,416 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-04 07:53:18,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01650785407854562, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.026003731254514263, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04279515585622627, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.026003731254514263, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0465, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-04 07:53:18,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 1028 regions; Going from a computed imbalance of 0.01650785407854562 to a new imbalance of 9.40065149926397E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00879722660329461); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01282708974011244); MoveCostFunction : (multiplier=7.0, imbalance=0.11422222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00879722660329461); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:18,741 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1521900402:82 , srv587729861:82 , srv847519359:82 , srv1099962731:83 , srv1298756333:83 , srv1387024109:83 , srv1405919120:83 , srv200621208:83 , srv40694778:83 , srv516895204:83 , srv847718605:83 , srv1122211945:84 , srv1126137521:84 , srv1250557334:84 , srv1266642660:84 , srv1349574899:84 , srv1396976188:84 , srv1406543651:84 , srv156386445:84 , srv1832005045:84 , srv184984496:84 , srv1907323615:84 , srv2136250875:84 , srv243215662:84 , srv376121313:84 , srv604175077:84 , srv677681235:84 , srv872840276:84 , srv948909291:84 , srv989892699:84 , srv991931239:84 , srv1045582566:85 , srv1253573556:85 , srv1393485513:85 , srv157872147:85 , srv1582482324:85 , srv1633275020:85 , srv1635906814:85 , srv1673881680:85 , srv1766669139:85 , srv1996425134:85 , srv2050480257:85 , srv2123994676:85 , srv607911933:85 , srv704183411:85 , srv720743357:85 , srv726819777:85 , srv787551291:85 , srv936351798:85 , srv957285703:85 , srv1139123512:86 , srv1156650518:86 , srv1211485581:86 , srv1420315885:86 , srv1584480506:86 , srv1670938841:86 , srv1677947637:86 , srv1678023081:86 , srv1825744078:86 , srv2005378914:86 , srv2030934209:86 , srv387404454:86 , srv430512978:86 , srv490758159:86 , srv540175033:86 , srv773518629:86 , srv899277298:86 , srv1004430696:87 , srv1105470631:87 , srv1170463775:87 , srv1172087455:87 , srv1517325424:87 , srv1761620149:87 , srv1763278771:87 , srv209210532:87 , srv2110658933:87 , srv2112199847:87 , srv246018550:87 , srv273108591:87 , srv278348345:87 , srv33198222:87 , srv33225300:87 , srv599024465:87 , srv660682784:87 , srv731324567:87 , srv802550830:87 , srv888769919:87 , srv944935093:87 , srv108848335:88 , srv1628799284:88 , srv1898158083:88 , srv2070340685:88 , srv355225014:88 , srv793420545:88 , srv1357349700:89 , srv307949328:89 , srv476596173:89 , srv2086626661:90 , srv74527010:90 , srv947797088:531 }
2024-04-04 07:53:18,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:18,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:18,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:18,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:18,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:18,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:18,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:18,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:18,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:18,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:18,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:18,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:18,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00879722660329461); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01282708974011244); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00879722660329461); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:18,892 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-04 07:53:18,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.328669400759729E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00879722660329461); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01282708974011244); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00879722660329461); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-04 07:53:19,312 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 530 ms to try 5000 different iterations.  Found a solution that moves 309 regions; Going from a computed imbalance of 9.328669400759729E-4 to a new imbalance of 3.661351241688681E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.034333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:19,313 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1122211945:83 , srv1170463775:83 , srv1298756333:83 , srv1517325424:83 , srv731324567:83 , srv793420545:83 , srv1004430696:84 , srv1045582566:84 , srv1105470631:84 , srv1172087455:84 , srv1211485581:84 , srv1349574899:84 , srv1357349700:84 , srv1396976188:84 , srv1405919120:84 , srv156386445:84 , srv157872147:84 , srv1584480506:84 , srv1628799284:84 , srv1635906814:84 , srv1996425134:84 , srv200621208:84 , srv2086626661:84 , srv2112199847:84 , srv2136250875:84 , srv273108591:84 , srv33225300:84 , srv355225014:84 , srv430512978:84 , srv476596173:84 , srv516895204:84 , srv607911933:84 , srv726819777:84 , srv773518629:84 , srv847519359:84 , srv899277298:84 , srv944935093:84 , srv108848335:85 , srv1139123512:85 , srv1266642660:85 , srv1387024109:85 , srv1393485513:85 , srv1521900402:85 , srv1582482324:85 , srv1633275020:85 , srv1670938841:85 , srv1677947637:85 , srv1761620149:85 , srv1763278771:85 , srv1766669139:85 , srv1832005045:85 , srv1898158083:85 , srv1907323615:85 , srv2005378914:85 , srv2030934209:85 , srv2050480257:85 , srv2070340685:85 , srv209210532:85 , srv2123994676:85 , srv307949328:85 , srv33198222:85 , srv376121313:85 , srv387404454:85 , srv40694778:85 , srv490758159:85 , srv540175033:85 , srv587729861:85 , srv599024465:85 , srv604175077:85 , srv677681235:85 , srv704183411:85 , srv74527010:85 , srv787551291:85 , srv802550830:85 , srv872840276:85 , srv888769919:85 , srv957285703:85 , srv991931239:85 , srv1099962731:86 , srv1156650518:86 , srv1250557334:86 , srv1253573556:86 , srv1406543651:86 , srv1420315885:86 , srv1673881680:86 , srv1678023081:86 , srv1825744078:86 , srv184984496:86 , srv2110658933:86 , srv243215662:86 , srv246018550:86 , srv278348345:86 , srv660682784:86 , srv720743357:86 , srv847718605:86 , srv936351798:86 , srv948909291:86 , srv989892699:86 , srv1126137521:87 , srv947797088:606 }
2024-04-04 07:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:19,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:19,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:19,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:19,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:19,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:19,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:19,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:19,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:19,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:19,437 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-04 07:53:19,437 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.4449848171963614E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-04 07:53:19,687 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 345 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 3.4449848171963614E-5 to a new imbalance of 7.297308085447707E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:19,687 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1126137521:83 , srv1250557334:83 , srv1253573556:83 , srv184984496:83 , srv2070340685:83 , srv209210532:83 , srv660682784:83 , srv720743357:83 , srv989892699:83 , srv1004430696:84 , srv1045582566:84 , srv108848335:84 , srv1099962731:84 , srv1105470631:84 , srv1122211945:84 , srv1139123512:84 , srv1156650518:84 , srv1170463775:84 , srv1211485581:84 , srv1266642660:84 , srv1349574899:84 , srv1357349700:84 , srv1387024109:84 , srv1393485513:84 , srv1396976188:84 , srv1405919120:84 , srv1406543651:84 , srv1420315885:84 , srv1521900402:84 , srv156386445:84 , srv1582482324:84 , srv1584480506:84 , srv1628799284:84 , srv1633275020:84 , srv1635906814:84 , srv1670938841:84 , srv1673881680:84 , srv1677947637:84 , srv1678023081:84 , srv1761620149:84 , srv1763278771:84 , srv1766669139:84 , srv1825744078:84 , srv1832005045:84 , srv1898158083:84 , srv1907323615:84 , srv1996425134:84 , srv2005378914:84 , srv200621208:84 , srv2030934209:84 , srv2050480257:84 , srv2086626661:84 , srv2110658933:84 , srv2112199847:84 , srv2123994676:84 , srv2136250875:84 , srv243215662:84 , srv246018550:84 , srv278348345:84 , srv307949328:84 , srv33198222:84 , srv33225300:84 , srv376121313:84 , srv387404454:84 , srv430512978:84 , srv476596173:84 , srv490758159:84 , srv516895204:84 , srv540175033:84 , srv587729861:84 , srv599024465:84 , srv604175077:84 , srv607911933:84 , srv677681235:84 , srv704183411:84 , srv726819777:84 , srv731324567:84 , srv74527010:84 , srv773518629:84 , srv787551291:84 , srv793420545:84 , srv802550830:84 , srv847519359:84 , srv847718605:84 , srv872840276:84 , srv899277298:84 , srv936351798:84 , srv944935093:84 , srv948909291:84 , srv957285703:84 , srv991931239:84 , srv1172087455:85 , srv1298756333:85 , srv1517325424:85 , srv157872147:85 , srv355225014:85 , srv40694778:85 , srv888769919:85 , srv273108591:86 , srv947797088:684 }
2024-04-04 07:53:19,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:19,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1517325424=24, srv108848335=2, srv899277298=92, srv677681235=78, srv720743357=80, srv1420315885=23, srv430512978=68, srv273108591=59, srv1004430696=0, srv40694778=67, srv1582482324=28, srv387404454=66, srv787551291=85, srv246018550=58, srv1266642660=14, srv607911933=76, srv1584480506=29, srv476596173=69, srv209210532=52, srv1766669139=39, srv1045582566=1, srv1832005045=41, srv1253573556=13, srv278348345=60, srv726819777=81, srv989892699=98, srv1405919120=21, srv2050480257=49, srv2086626661=51, srv587729861=73, srv872840276=90, srv1521900402=25, srv1635906814=32, srv33225300=63, srv307949328=61, srv184984496=42, srv936351798=93, srv2112199847=54, srv156386445=26, srv1122211945=5, srv1761620149=37, srv355225014=64, srv1099962731=3, srv1211485581=11, srv516895204=71, srv991931239=99, srv74527010=83, srv1628799284=30, srv1633275020=31, srv847718605=89, srv1670938841=33, srv2005378914=46, srv1250557334=12, srv243215662=57, srv376121313=65, srv1677947637=35, srv33198222=62, srv604175077=75, srv599024465=74, srv802550830=87, srv540175033=72, srv793420545=86, srv1406543651=22, srv1156650518=8, srv490758159=70, srv1126137521=6, srv1996425134=45, srv1393485513=19, srv1105470631=4, srv1825744078=40, srv1349574899=16, srv1678023081=36, srv888769919=91, srv1763278771=38, srv1172087455=10, srv1673881680=34, srv2136250875=56, srv2123994676=55, srv1170463775=9, srv847519359=88, srv944935093=94, srv1357349700=17, srv1298756333=15, srv1898158083=43, srv731324567=82, srv1396976188=20, srv157872147=27, srv2070340685=50, srv947797088=95, srv1387024109=18, srv1907323615=44, srv2030934209=48, srv773518629=84, srv704183411=79, srv2110658933=53, srv660682784=77, srv948909291=96, srv200621208=47, srv1139123512=7, srv957285703=97} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:19,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:19,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:19,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:19,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:19,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:19,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-04 07:53:19,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-04 07:53:19,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-04 07:53:19,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-04 07:53:19,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-04 07:53:19,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:19,813 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1126137521:83 , srv1250557334:83 , srv1253573556:83 , srv184984496:83 , srv2070340685:83 , srv209210532:83 , srv660682784:83 , srv720743357:83 , srv989892699:83 , srv1004430696:84 , srv1045582566:84 , srv108848335:84 , srv1099962731:84 , srv1105470631:84 , srv1122211945:84 , srv1139123512:84 , srv1156650518:84 , srv1170463775:84 , srv1211485581:84 , srv1266642660:84 , srv1349574899:84 , srv1357349700:84 , srv1387024109:84 , srv1393485513:84 , srv1396976188:84 , srv1405919120:84 , srv1406543651:84 , srv1420315885:84 , srv1521900402:84 , srv156386445:84 , srv1582482324:84 , srv1584480506:84 , srv1628799284:84 , srv1633275020:84 , srv1635906814:84 , srv1670938841:84 , srv1673881680:84 , srv1677947637:84 , srv1678023081:84 , srv1761620149:84 , srv1763278771:84 , srv1766669139:84 , srv1825744078:84 , srv1832005045:84 , srv1898158083:84 , srv1907323615:84 , srv1996425134:84 , srv2005378914:84 , srv200621208:84 , srv2030934209:84 , srv2050480257:84 , srv2086626661:84 , srv2110658933:84 , srv2112199847:84 , srv2123994676:84 , srv2136250875:84 , srv243215662:84 , srv246018550:84 , srv278348345:84 , srv307949328:84 , srv33198222:84 , srv33225300:84 , srv376121313:84 , srv387404454:84 , srv430512978:84 , srv476596173:84 , srv490758159:84 , srv516895204:84 , srv540175033:84 , srv587729861:84 , srv599024465:84 , srv604175077:84 , srv607911933:84 , srv677681235:84 , srv704183411:84 , srv726819777:84 , srv731324567:84 , srv74527010:84 , srv773518629:84 , srv787551291:84 , srv793420545:84 , srv802550830:84 , srv847519359:84 , srv847718605:84 , srv872840276:84 , srv899277298:84 , srv936351798:84 , srv944935093:84 , srv948909291:84 , srv957285703:84 , srv991931239:84 , srv1172087455:85 , srv1298756333:85 , srv1517325424:85 , srv157872147:85 , srv355225014:85 , srv40694778:85 , srv888769919:85 , srv273108591:86 , srv947797088:684 }
2024-04-04 07:53:19,839 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 293), ProcessCount=170 (was 170), AvailableMemoryMB=7033 (was 7795)
2024-04-04 07:53:19,848 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=293, ProcessCount=170, AvailableMemoryMB=7032
2024-04-04 07:53:19,848 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-04 07:53:19,848 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-04 07:53:19,857 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1050477850:84 , srv1068407166:84 , srv1102383390:84 , srv1164481972:84 , srv1200301331:84 , srv1275659643:84 , srv1373924798:84 , srv1471279213:84 , srv1492550519:84 , srv1535264635:84 , srv1540383549:84 , srv1542082578:84 , srv1604157425:84 , srv161220831:84 , srv1634862741:84 , srv1723224672:84 , srv1734677732:84 , srv1767665429:84 , srv1784621712:84 , srv1982345797:84 , srv1998527810:84 , srv2094961935:84 , srv241614870:84 , srv271732692:84 , srv437773930:84 , srv748354010:84 , srv760363854:84 , srv845310032:84 , srv864025332:84 , srv1240226293:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-04 07:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:53:19,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1200301331=4, srv1240226293=5, srv1471279213=8, srv1723224672=16, srv1275659643=6, srv437773930=25, srv1767665429=18, srv1982345797=20, srv1604157425=13, srv1050477850=0, srv1102383390=2, srv1540383549=11, srv1373924798=7, srv1535264635=10, srv1542082578=12, srv271732692=24, srv1634862741=15, srv864025332=29, srv1998527810=21, srv1492550519=9, srv1164481972=3, srv161220831=14, srv241614870=23, srv845310032=28, srv1068407166=1, srv760363854=27, srv1734677732=17, srv748354010=26, srv1784621712=19, srv2094961935=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:53:19,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:53:19,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-04 07:53:19,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1005683856108812, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:53:19,883 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912509930963479, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1005683856108812, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-04 07:55:19,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5389497 different iterations.  Found a solution that moves 1854 regions; Going from a computed imbalance of 0.9912509930963479 to a new imbalance of 4.3273284898463826E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:55:19,877 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1050477850:90 , srv1068407166:90 , srv1102383390:90 , srv1164481972:90 , srv1200301331:90 , srv1240226293:90 , srv1275659643:90 , srv1373924798:90 , srv1471279213:90 , srv1492550519:90 , srv1535264635:90 , srv1540383549:90 , srv1542082578:90 , srv1604157425:90 , srv161220831:90 , srv1634862741:90 , srv1723224672:90 , srv1734677732:90 , srv1767665429:90 , srv1784621712:90 , srv1982345797:90 , srv1998527810:90 , srv2094961935:90 , srv241614870:90 , srv271732692:90 , srv437773930:90 , srv748354010:90 , srv760363854:90 , srv845310032:90 , srv864025332:90 }
2024-04-04 07:55:19,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-04 07:55:19,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1200301331=4, srv1240226293=5, srv1471279213=8, srv1723224672=16, srv1275659643=6, srv437773930=25, srv1767665429=18, srv1982345797=20, srv1604157425=13, srv1050477850=0, srv1102383390=2, srv1540383549=11, srv1373924798=7, srv1535264635=10, srv1542082578=12, srv271732692=24, srv1634862741=15, srv864025332=29, srv1998527810=21, srv1492550519=9, srv1164481972=3, srv161220831=14, srv241614870=23, srv845310032=28, srv1068407166=1, srv760363854=27, srv1734677732=17, srv748354010=26, srv1784621712=19, srv2094961935=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-04 07:55:19,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-04 07:55:19,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-04 07:55:19,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-04 07:55:19,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-04 07:55:19,898 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1050477850:90 , srv1068407166:90 , srv1102383390:90 , srv1164481972:90 , srv1200301331:90 , srv1240226293:90 , srv1275659643:90 , srv1373924798:90 , srv1471279213:90 , srv1492550519:90 , srv1535264635:90 , srv1540383549:90 , srv1542082578:90 , srv1604157425:90 , srv161220831:90 , srv1634862741:90 , srv1723224672:90 , srv1734677732:90 , srv1767665429:90 , srv1784621712:90 , srv1982345797:90 , srv1998527810:90 , srv2094961935:90 , srv241614870:90 , srv271732692:90 , srv437773930:90 , srv748354010:90 , srv760363854:90 , srv845310032:90 , srv864025332:90 }
2024-04-04 07:55:19,915 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 293) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 170), AvailableMemoryMB=6286 (was 7032)