2023-10-24 06:56:03,957 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-24 06:56:04,191 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-24 06:56:04,279 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-24 06:56:04,333 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 06:56:04,339 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 06:56:04,350 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=168, AvailableMemoryMB=4118
2023-10-24 06:56:04,352 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 06:56:04,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 06:56:04,457 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002330733:84 , srv1003206143:84 , srv1006541441:84 , srv1011340757:84 , srv104006883:84 , srv1041446435:84 , srv1072020307:84 , srv1083297174:84 , srv1098615434:84 , srv1107867780:84 , srv1121372071:84 , srv1157291511:84 , srv1221145438:84 , srv1224595936:84 , srv1233770058:84 , srv132795685:84 , srv1331859448:84 , srv1361057820:84 , srv1386706682:84 , srv1406669907:84 , srv1413725549:84 , srv1415294718:84 , srv1417179416:84 , srv1422088110:84 , srv1422866598:84 , srv1427742464:84 , srv1445679416:84 , srv144868772:84 , srv1465352296:84 , srv1466067024:84 , srv1510602766:84 , srv152467832:84 , srv1594270289:84 , srv1596131845:84 , srv1615738140:84 , srv1628395644:84 , srv1651023527:84 , srv1655868406:84 , srv165671487:84 , srv1656837265:84 , srv1660022845:84 , srv1680043976:84 , srv1680213024:84 , srv1713750800:84 , srv1714316853:84 , srv171844542:84 , srv1735115743:84 , srv1794702295:84 , srv180877489:84 , srv1816387884:84 , srv1852111396:84 , srv1882736273:84 , srv1887191411:84 , srv191244897:84 , srv1922859135:84 , srv1942377055:84 , srv1982462738:84 , srv2000284756:84 , srv2045694719:84 , srv2112875488:84 , srv2116249226:84 , srv2119182435:84 , srv2124434361:84 , srv233082538:84 , srv243318667:84 , srv25078126:84 , srv288283126:84 , srv372572336:84 , srv377438218:84 , srv391485546:84 , srv419625773:84 , srv479184061:84 , srv485572478:84 , srv491183578:84 , srv491793151:84 , srv494143759:84 , srv533883520:84 , srv537175005:84 , srv547102323:84 , srv560428622:84 , srv604317640:84 , srv630901836:84 , srv644953128:84 , srv660174008:84 , srv685081833:84 , srv726774178:84 , srv743695677:84 , srv757556885:84 , srv757784255:84 , srv805537631:84 , srv817324286:84 , srv821749863:84 , srv861025684:84 , srv879605228:84 , srv88531892:84 , srv934458687:84 , srv9446877:84 , srv957188762:84 , srv977805028:84 , srv101480445:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-24 06:56:04,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:04,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:04,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:04,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:04,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:04,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:04,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:04,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:04,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:04,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:04,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:04,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:04,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:04,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:04,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:04,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:04,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:04,702 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 06:56:04,702 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 06:56:05,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 591 ms to try 5000 different iterations.  Found a solution that moves 4641 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18567880867674416. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826287869816002, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05279611589971861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5156666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826287869816002, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,175 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1656837265:82 , srv191244897:82 , srv1651023527:83 , srv1660022845:83 , srv377438218:83 , srv491793151:83 , srv685081833:83 , srv726774178:83 , srv757784255:83 , srv805537631:83 , srv861025684:83 , srv1041446435:84 , srv1361057820:84 , srv1427742464:84 , srv1615738140:84 , srv1735115743:84 , srv2045694719:84 , srv2124434361:84 , srv419625773:84 , srv604317640:84 , srv821749863:84 , srv1006541441:85 , srv104006883:85 , srv1224595936:85 , srv1331859448:85 , srv1628395644:85 , srv1655868406:85 , srv1680043976:85 , srv1922859135:85 , srv2119182435:85 , srv25078126:85 , srv479184061:85 , srv560428622:85 , srv977805028:85 , srv1003206143:86 , srv1221145438:86 , srv1386706682:86 , srv1422866598:86 , srv1466067024:86 , srv165671487:86 , srv1714316853:86 , srv171844542:86 , srv1816387884:86 , srv1882736273:86 , srv1887191411:86 , srv243318667:86 , srv372572336:86 , srv533883520:86 , srv757556885:86 , srv879605228:86 , srv1011340757:87 , srv1083297174:87 , srv1098615434:87 , srv1157291511:87 , srv1233770058:87 , srv1413725549:87 , srv1422088110:87 , srv1445679416:87 , srv144868772:87 , srv1465352296:87 , srv152467832:87 , srv1594270289:87 , srv1596131845:87 , srv1680213024:87 , srv1713750800:87 , srv1942377055:87 , srv2116249226:87 , srv233082538:87 , srv391485546:87 , srv491183578:87 , srv817324286:87 , srv88531892:87 , srv1107867780:88 , srv1121372071:88 , srv1406669907:88 , srv1415294718:88 , srv1417179416:88 , srv1510602766:88 , srv2000284756:88 , srv2112875488:88 , srv485572478:88 , srv630901836:88 , srv9446877:88 , srv1002330733:89 , srv1982462738:89 , srv288283126:89 , srv1072020307:90 , srv180877489:90 , srv132795685:91 , srv1852111396:91 , srv547102323:91 , srv644953128:91 , srv660174008:91 , srv957188762:91 , srv1794702295:92 , srv494143759:92 , srv537175005:92 , srv934458687:92 , srv743695677:95 , srv101480445:430 }
2023-10-24 06:56:05,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:05,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:05,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:05,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:05,203 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:05,204 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:05,205 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:05,206 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:05,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:05,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:05,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826287869816002, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05279611589971861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826287869816002, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,321 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 06:56:05,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18564631170017235, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03826287869816002, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05279611589971861, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03826287869816002, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18083333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24908333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 06:56:05,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 259 ms to try 5000 different iterations.  Found a solution that moves 2704 regions; Going from a computed imbalance of 0.18564631170017235 to a new imbalance of 0.013581030488031753. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019814578808500426); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03167242549088828, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30044444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019814578808500426); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,496 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv743695677:79 , srv644953128:80 , srv660174008:80 , srv1002330733:81 , srv132795685:81 , srv1794702295:81 , srv494143759:81 , srv537175005:81 , srv934458687:81 , srv1852111396:82 , srv288283126:82 , srv547102323:82 , srv1011340757:83 , srv1072020307:83 , srv1417179416:83 , srv144868772:83 , srv1465352296:83 , srv233082538:83 , srv630901836:83 , srv1003206143:84 , srv1157291511:84 , srv1233770058:84 , srv1406669907:84 , srv1422088110:84 , srv1713750800:84 , srv180877489:84 , srv1982462738:84 , srv372572336:84 , srv391485546:84 , srv817324286:84 , srv88531892:84 , srv957188762:84 , srv1083297174:85 , srv1107867780:85 , srv1121372071:85 , srv1221145438:85 , srv1415294718:85 , srv1594270289:85 , srv1596131845:85 , srv1628395644:85 , srv1680213024:85 , srv1714316853:85 , srv2000284756:85 , srv2116249226:85 , srv243318667:85 , srv491183578:85 , srv533883520:85 , srv879605228:85 , srv1098615434:86 , srv1445679416:86 , srv1466067024:86 , srv1510602766:86 , srv152467832:86 , srv1816387884:86 , srv1882736273:86 , srv2112875488:86 , srv25078126:86 , srv479184061:86 , srv485572478:86 , srv977805028:86 , srv1006541441:87 , srv1224595936:87 , srv1331859448:87 , srv1361057820:87 , srv1413725549:87 , srv1615738140:87 , srv1655868406:87 , srv165671487:87 , srv1922859135:87 , srv1942377055:87 , srv2045694719:87 , srv2119182435:87 , srv419625773:87 , srv726774178:87 , srv757556885:87 , srv821749863:87 , srv104006883:88 , srv1422866598:88 , srv1427742464:88 , srv1651023527:88 , srv1735115743:88 , srv1887191411:88 , srv9446877:88 , srv1041446435:89 , srv1386706682:89 , srv1656837265:89 , srv171844542:89 , srv191244897:89 , srv491793151:89 , srv604317640:89 , srv1680043976:90 , srv2124434361:90 , srv560428622:90 , srv685081833:90 , srv757784255:90 , srv805537631:90 , srv1660022845:91 , srv377438218:91 , srv861025684:91 , srv101480445:520 }
2023-10-24 06:56:05,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:05,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:05,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:05,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:05,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:05,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:05,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:05,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:05,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:05,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:05,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:05,603 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019814578808500426); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03167242549088828, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019814578808500426); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,604 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 06:56:05,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01356209667535126, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019814578808500426); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03167242549088828, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019814578808500426); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 06:56:05,742 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 209 ms to try 5000 different iterations.  Found a solution that moves 1009 regions; Going from a computed imbalance of 0.01356209667535126 to a new imbalance of 8.885209216051638E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00433938683335991); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.1121111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00433938683335991); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,744 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1386706682:82 , srv9446877:82 , srv957188762:82 , srv1413725549:83 , srv1680043976:83 , srv171844542:83 , srv1887191411:83 , srv2112875488:83 , srv2124434361:83 , srv560428622:83 , srv743695677:83 , srv861025684:83 , srv1041446435:84 , srv1107867780:84 , srv1415294718:84 , srv1422866598:84 , srv1510602766:84 , srv1660022845:84 , srv180877489:84 , srv377438218:84 , srv485572478:84 , srv494143759:84 , srv537175005:84 , srv547102323:84 , srv685081833:84 , srv934458687:84 , srv104006883:85 , srv1072020307:85 , srv1083297174:85 , srv1098615434:85 , srv1121372071:85 , srv1224595936:85 , srv1331859448:85 , srv1406669907:85 , srv1427742464:85 , srv1445679416:85 , srv152467832:85 , srv1594270289:85 , srv165671487:85 , srv1680213024:85 , srv1794702295:85 , srv1942377055:85 , srv1982462738:85 , srv2000284756:85 , srv2119182435:85 , srv491793151:85 , srv757556885:85 , srv805537631:85 , srv1157291511:86 , srv1221145438:86 , srv1361057820:86 , srv1417179416:86 , srv1466067024:86 , srv1596131845:86 , srv1615738140:86 , srv1651023527:86 , srv1655868406:86 , srv1713750800:86 , srv1714316853:86 , srv1735115743:86 , srv1852111396:86 , srv1882736273:86 , srv191244897:86 , srv1922859135:86 , srv2045694719:86 , srv2116249226:86 , srv243318667:86 , srv25078126:86 , srv288283126:86 , srv391485546:86 , srv479184061:86 , srv491183578:86 , srv604317640:86 , srv757784255:86 , srv817324286:86 , srv821749863:86 , srv879605228:86 , srv977805028:86 , srv1003206143:87 , srv1006541441:87 , srv1233770058:87 , srv1422088110:87 , srv1465352296:87 , srv1656837265:87 , srv1816387884:87 , srv233082538:87 , srv372572336:87 , srv419625773:87 , srv630901836:87 , srv644953128:87 , srv660174008:87 , srv726774178:87 , srv88531892:87 , srv1002330733:88 , srv144868772:88 , srv1628395644:88 , srv533883520:88 , srv1011340757:89 , srv132795685:89 , srv101480445:546 }
2023-10-24 06:56:05,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:05,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:05,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:05,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:05,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:05,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:05,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:05,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:05,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:05,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:05,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:05,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:05,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:05,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:05,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00433938683335991); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00433938683335991); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:05,841 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 06:56:05,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.814557525982787E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00433938683335991); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007842444017689564); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00433938683335991); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 06:56:06,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 276 ms to try 5000 different iterations.  Found a solution that moves 282 regions; Going from a computed imbalance of 8.814557525982787E-4 to a new imbalance of 2.764436123346527E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.03133333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:06,047 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv132795685:81 , srv1942377055:82 , srv533883520:82 , srv1002330733:83 , srv1006541441:83 , srv1628395644:83 , srv1816387884:83 , srv1852111396:83 , srv604317640:83 , srv757784255:83 , srv1003206143:84 , srv1011340757:84 , srv104006883:84 , srv1072020307:84 , srv1098615434:84 , srv1121372071:84 , srv1233770058:84 , srv1415294718:84 , srv1422088110:84 , srv1422866598:84 , srv1445679416:84 , srv144868772:84 , srv1466067024:84 , srv1510602766:84 , srv152467832:84 , srv1596131845:84 , srv1655868406:84 , srv1656837265:84 , srv1660022845:84 , srv1680043976:84 , srv171844542:84 , srv1735115743:84 , srv1794702295:84 , srv1882736273:84 , srv191244897:84 , srv1922859135:84 , srv2000284756:84 , srv2116249226:84 , srv377438218:84 , srv419625773:84 , srv485572478:84 , srv491183578:84 , srv494143759:84 , srv560428622:84 , srv630901836:84 , srv644953128:84 , srv660174008:84 , srv685081833:84 , srv757556885:84 , srv805537631:84 , srv821749863:84 , srv88531892:84 , srv9446877:84 , srv1083297174:85 , srv1107867780:85 , srv1157291511:85 , srv1221145438:85 , srv1224595936:85 , srv1331859448:85 , srv1361057820:85 , srv1386706682:85 , srv1406669907:85 , srv1413725549:85 , srv1427742464:85 , srv1465352296:85 , srv1615738140:85 , srv1651023527:85 , srv165671487:85 , srv1680213024:85 , srv1713750800:85 , srv1714316853:85 , srv180877489:85 , srv1887191411:85 , srv1982462738:85 , srv2112875488:85 , srv2119182435:85 , srv233082538:85 , srv243318667:85 , srv25078126:85 , srv372572336:85 , srv391485546:85 , srv479184061:85 , srv491793151:85 , srv537175005:85 , srv547102323:85 , srv726774178:85 , srv743695677:85 , srv817324286:85 , srv861025684:85 , srv879605228:85 , srv934458687:85 , srv957188762:85 , srv977805028:85 , srv1041446435:86 , srv1417179416:86 , srv1594270289:86 , srv2045694719:86 , srv2124434361:86 , srv288283126:86 , srv101480445:646 }
2023-10-24 06:56:06,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:06,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:06,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:06,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:06,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:06,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:06,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:06,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:06,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:06,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:06,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:06,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:06,153 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 06:56:06,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.566975502936061E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 06:56:06,287 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 213 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.566975502936061E-5 to a new imbalance of 7.822462643889748E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:06,288 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011340757:83 , srv1041446435:83 , srv1417179416:83 , srv1594270289:83 , srv165671487:83 , srv180877489:83 , srv1982462738:83 , srv2045694719:83 , srv2124434361:83 , srv288283126:83 , srv1006541441:84 , srv104006883:84 , srv1072020307:84 , srv1083297174:84 , srv1098615434:84 , srv1107867780:84 , srv1121372071:84 , srv1157291511:84 , srv1221145438:84 , srv1224595936:84 , srv1233770058:84 , srv132795685:84 , srv1331859448:84 , srv1361057820:84 , srv1386706682:84 , srv1406669907:84 , srv1413725549:84 , srv1422088110:84 , srv1422866598:84 , srv1427742464:84 , srv1445679416:84 , srv144868772:84 , srv1465352296:84 , srv1466067024:84 , srv1510602766:84 , srv152467832:84 , srv1596131845:84 , srv1615738140:84 , srv1651023527:84 , srv1655868406:84 , srv1656837265:84 , srv1660022845:84 , srv1680043976:84 , srv1680213024:84 , srv1713750800:84 , srv1714316853:84 , srv171844542:84 , srv1735115743:84 , srv1794702295:84 , srv1816387884:84 , srv1852111396:84 , srv1882736273:84 , srv1887191411:84 , srv1922859135:84 , srv2000284756:84 , srv2112875488:84 , srv2116249226:84 , srv2119182435:84 , srv233082538:84 , srv243318667:84 , srv25078126:84 , srv372572336:84 , srv377438218:84 , srv391485546:84 , srv419625773:84 , srv479184061:84 , srv485572478:84 , srv491183578:84 , srv491793151:84 , srv537175005:84 , srv547102323:84 , srv560428622:84 , srv604317640:84 , srv630901836:84 , srv644953128:84 , srv660174008:84 , srv726774178:84 , srv743695677:84 , srv757556885:84 , srv757784255:84 , srv805537631:84 , srv817324286:84 , srv861025684:84 , srv879605228:84 , srv88531892:84 , srv934458687:84 , srv9446877:84 , srv957188762:84 , srv977805028:84 , srv1002330733:85 , srv1003206143:85 , srv1415294718:85 , srv1628395644:85 , srv191244897:85 , srv1942377055:85 , srv494143759:85 , srv533883520:85 , srv685081833:85 , srv821749863:85 , srv101480445:684 }
2023-10-24 06:56:06,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:06,291 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417179416=23, srv377438218=69, srv191244897=54, srv1098615434=9, srv1331859448=17, srv1816387884=50, srv144868772=28, srv757784255=89, srv1596131845=34, srv1465352296=29, srv1628395644=36, srv1713750800=44, srv1735115743=47, srv1656837265=40, srv1422088110=24, srv1680213024=43, srv879605228=94, srv1882736273=52, srv1011340757=3, srv1427742464=26, srv1107867780=10, srv1887191411=53, srv861025684=93, srv537175005=78, srv805537631=90, srv2045694719=59, srv1655868406=38, srv1680043976=42, srv165671487=39, srv419625773=71, srv491793151=75, srv817324286=91, srv1794702295=48, srv1221145438=13, srv660174008=84, srv1422866598=25, srv934458687=96, srv104006883=5, srv1072020307=7, srv644953128=83, srv2000284756=58, srv1651023527=37, srv1942377055=56, srv9446877=97, srv547102323=79, srv1982462738=57, srv1510602766=31, srv288283126=67, srv957188762=98, srv494143759=76, srv1413725549=21, srv485572478=73, srv1852111396=51, srv560428622=80, srv2124434361=63, srv152467832=32, srv1415294718=22, srv479184061=72, srv1594270289=33, srv2119182435=62, srv1660022845=41, srv1386706682=19, srv1466067024=30, srv180877489=49, srv757556885=88, srv1406669907=20, srv171844542=46, srv1922859135=55, srv604317640=81, srv2112875488=60, srv1006541441=2, srv1361057820=18, srv1714316853=45, srv101480445=4, srv1157291511=12, srv372572336=68, srv1003206143=1, srv1233770058=15, srv243318667=65, srv1002330733=0, srv533883520=77, srv233082538=64, srv685081833=85, srv977805028=99, srv743695677=87, srv821749863=92, srv25078126=66, srv1445679416=27, srv726774178=86, srv88531892=95, srv391485546=70, srv630901836=82, srv1121372071=11, srv1041446435=6, srv1615738140=35, srv1083297174=8, srv132795685=16, srv491183578=74, srv2116249226=61, srv1224595936=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:06,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 06:56:06,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 06:56:06,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 06:56:06,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 06:56:06,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 06:56:06,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 06:56:06,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 06:56:06,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 06:56:06,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 06:56:06,391 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:06,392 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1011340757:83 , srv1041446435:83 , srv1417179416:83 , srv1594270289:83 , srv165671487:83 , srv180877489:83 , srv1982462738:83 , srv2045694719:83 , srv2124434361:83 , srv288283126:83 , srv1006541441:84 , srv104006883:84 , srv1072020307:84 , srv1083297174:84 , srv1098615434:84 , srv1107867780:84 , srv1121372071:84 , srv1157291511:84 , srv1221145438:84 , srv1224595936:84 , srv1233770058:84 , srv132795685:84 , srv1331859448:84 , srv1361057820:84 , srv1386706682:84 , srv1406669907:84 , srv1413725549:84 , srv1422088110:84 , srv1422866598:84 , srv1427742464:84 , srv1445679416:84 , srv144868772:84 , srv1465352296:84 , srv1466067024:84 , srv1510602766:84 , srv152467832:84 , srv1596131845:84 , srv1615738140:84 , srv1651023527:84 , srv1655868406:84 , srv1656837265:84 , srv1660022845:84 , srv1680043976:84 , srv1680213024:84 , srv1713750800:84 , srv1714316853:84 , srv171844542:84 , srv1735115743:84 , srv1794702295:84 , srv1816387884:84 , srv1852111396:84 , srv1882736273:84 , srv1887191411:84 , srv1922859135:84 , srv2000284756:84 , srv2112875488:84 , srv2116249226:84 , srv2119182435:84 , srv233082538:84 , srv243318667:84 , srv25078126:84 , srv372572336:84 , srv377438218:84 , srv391485546:84 , srv419625773:84 , srv479184061:84 , srv485572478:84 , srv491183578:84 , srv491793151:84 , srv537175005:84 , srv547102323:84 , srv560428622:84 , srv604317640:84 , srv630901836:84 , srv644953128:84 , srv660174008:84 , srv726774178:84 , srv743695677:84 , srv757556885:84 , srv757784255:84 , srv805537631:84 , srv817324286:84 , srv861025684:84 , srv879605228:84 , srv88531892:84 , srv934458687:84 , srv9446877:84 , srv957188762:84 , srv977805028:84 , srv1002330733:85 , srv1003206143:85 , srv1415294718:85 , srv1628395644:85 , srv191244897:85 , srv1942377055:85 , srv494143759:85 , srv533883520:85 , srv685081833:85 , srv821749863:85 , srv101480445:684 }
2023-10-24 06:56:06,411 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 208), ProcessCount=168 (was 168), AvailableMemoryMB=3620 (was 4118)
2023-10-24 06:56:06,417 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=168, AvailableMemoryMB=3620
2023-10-24 06:56:06,418 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 06:56:06,418 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-24 06:56:06,426 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1082442676:84 , srv1121359856:84 , srv1125383595:84 , srv1170840795:84 , srv1187667017:84 , srv1266594016:84 , srv1335494334:84 , srv1335943411:84 , srv1451958341:84 , srv1517607084:84 , srv1534559482:84 , srv1579131523:84 , srv1733646831:84 , srv1832956305:84 , srv1846432628:84 , srv2001008127:84 , srv2057987606:84 , srv214853474:84 , srv236575972:84 , srv284843953:84 , srv413717450:84 , srv553358050:84 , srv579959493:84 , srv747994040:84 , srv75801582:84 , srv780343262:84 , srv854744569:84 , srv906930076:84 , srv998746937:84 , srv1144023022:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-24 06:56:06,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:56:06,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1534559482=11, srv553358050=22, srv236575972=19, srv1335943411=8, srv1579131523=12, srv579959493=23, srv854744569=27, srv998746937=29, srv2001008127=16, srv2057987606=17, srv780343262=26, srv906930076=28, srv413717450=21, srv1170840795=4, srv1266594016=6, srv1121359856=1, srv1451958341=9, srv1082442676=0, srv747994040=24, srv1125383595=2, srv1517607084=10, srv1832956305=14, srv1733646831=13, srv1187667017=5, srv1335494334=7, srv1846432628=15, srv284843953=20, srv214853474=18, srv1144023022=3, srv75801582=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:56:06,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:56:06,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:56:06,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 06:56:06,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322600946764403, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:56:06,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912609790503915, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1322600946764403, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-24 06:58:06,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 10030968 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912609790503915 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:58:06,447 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1082442676:90 , srv1121359856:90 , srv1125383595:90 , srv1144023022:90 , srv1170840795:90 , srv1187667017:90 , srv1266594016:90 , srv1335494334:90 , srv1335943411:90 , srv1451958341:90 , srv1517607084:90 , srv1534559482:90 , srv1579131523:90 , srv1733646831:90 , srv1832956305:90 , srv1846432628:90 , srv2001008127:90 , srv2057987606:90 , srv214853474:90 , srv236575972:90 , srv284843953:90 , srv413717450:90 , srv553358050:90 , srv579959493:90 , srv747994040:90 , srv75801582:90 , srv780343262:90 , srv854744569:90 , srv906930076:90 , srv998746937:90 }
2023-10-24 06:58:06,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 06:58:06,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1534559482=11, srv553358050=22, srv236575972=19, srv1335943411=8, srv1579131523=12, srv579959493=23, srv854744569=27, srv998746937=29, srv2001008127=16, srv2057987606=17, srv780343262=26, srv906930076=28, srv413717450=21, srv1170840795=4, srv1266594016=6, srv1121359856=1, srv1451958341=9, srv1082442676=0, srv747994040=24, srv1125383595=2, srv1517607084=10, srv1832956305=14, srv1733646831=13, srv1187667017=5, srv1335494334=7, srv1846432628=15, srv284843953=20, srv214853474=18, srv1144023022=3, srv75801582=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 06:58:06,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 06:58:06,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 06:58:06,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 06:58:06,466 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1082442676:90 , srv1121359856:90 , srv1125383595:90 , srv1144023022:90 , srv1170840795:90 , srv1187667017:90 , srv1266594016:90 , srv1335494334:90 , srv1335943411:90 , srv1451958341:90 , srv1517607084:90 , srv1534559482:90 , srv1579131523:90 , srv1733646831:90 , srv1832956305:90 , srv1846432628:90 , srv2001008127:90 , srv2057987606:90 , srv214853474:90 , srv236575972:90 , srv284843953:90 , srv413717450:90 , srv553358050:90 , srv579959493:90 , srv747994040:90 , srv75801582:90 , srv780343262:90 , srv854744569:90 , srv906930076:90 , srv998746937:90 }
2023-10-24 06:58:06,477 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 208), ProcessCount=168 (was 168), AvailableMemoryMB=3547 (was 3620)