2023-04-05 09:56:45,711 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-05 09:56:46,058 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-05 09:56:46,167 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-05 09:56:46,228 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 09:56:46,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 09:56:46,247 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=169, AvailableMemoryMB=2068
2023-04-05 09:56:46,249 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 09:56:46,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 09:56:46,372 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100709408:84 , srv1014124650:84 , srv1034850280:84 , srv1068329525:84 , srv1074376144:84 , srv1104142993:84 , srv1113275606:84 , srv1173593158:84 , srv1178105884:84 , srv1182298482:84 , srv119021754:84 , srv1191055467:84 , srv1228377288:84 , srv1266216833:84 , srv1330431968:84 , srv1332573754:84 , srv1350483096:84 , srv1384245980:84 , srv1461398210:84 , srv1472946981:84 , srv1505795139:84 , srv1506531956:84 , srv151820341:84 , srv1525189139:84 , srv1530098624:84 , srv1536806402:84 , srv1548495508:84 , srv1551231185:84 , srv1551502678:84 , srv1563433169:84 , srv1581098756:84 , srv1660851556:84 , srv1718786812:84 , srv1733145613:84 , srv1734284930:84 , srv1768890086:84 , srv177867414:84 , srv1784468462:84 , srv1801344619:84 , srv1816133462:84 , srv1847080810:84 , srv1900113941:84 , srv1903346204:84 , srv1931258776:84 , srv1935417005:84 , srv1939903100:84 , srv1981029995:84 , srv199650130:84 , srv2035298398:84 , srv2068462148:84 , srv2107281793:84 , srv2145704335:84 , srv228193877:84 , srv234698941:84 , srv262672817:84 , srv272807779:84 , srv273251182:84 , srv290475471:84 , srv292871290:84 , srv321120668:84 , srv324576078:84 , srv35820367:84 , srv368252531:84 , srv38950898:84 , srv398482126:84 , srv430388506:84 , srv447703162:84 , srv479793082:84 , srv482786853:84 , srv490169728:84 , srv550037804:84 , srv553023578:84 , srv585459578:84 , srv592812774:84 , srv593412587:84 , srv59672583:84 , srv615336567:84 , srv624535691:84 , srv678393378:84 , srv698063360:84 , srv70068510:84 , srv701847163:84 , srv724738355:84 , srv786312605:84 , srv802482686:84 , srv805494408:84 , srv806923764:84 , srv816758156:84 , srv822804968:84 , srv825935605:84 , srv837088425:84 , srv84330380:84 , srv858003230:84 , srv899649383:84 , srv924322301:84 , srv955106368:84 , srv974645998:84 , srv97672954:84 , srv983444459:84 , srv85285216:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-05 09:56:46,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:46,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:46,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:46,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:46,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:46,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:46,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:46,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:46,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:46,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:46,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:46,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:46,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:46,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:46,690 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 09:56:46,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 09:56:47,061 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 548 ms to try 5000 different iterations.  Found a solution that moves 4701 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17608774918860523. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03935823873699589, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057505184463486195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5223333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03935823873699589, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:47,074 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1931258776:82 , srv1935417005:82 , srv199650130:82 , srv119021754:83 , srv1191055467:83 , srv1461398210:83 , srv151820341:83 , srv1900113941:83 , srv447703162:83 , srv262672817:84 , srv816758156:84 , srv1034850280:85 , srv1113275606:85 , srv1182298482:85 , srv1266216833:85 , srv1332573754:85 , srv1525189139:85 , srv1551502678:85 , srv1768890086:85 , srv1903346204:85 , srv1939903100:85 , srv234698941:85 , srv290475471:85 , srv38950898:85 , srv479793082:85 , srv482786853:85 , srv490169728:85 , srv553023578:85 , srv698063360:85 , srv701847163:85 , srv805494408:85 , srv837088425:85 , srv858003230:85 , srv899649383:85 , srv983444459:85 , srv1104142993:86 , srv1173593158:86 , srv1350483096:86 , srv1384245980:86 , srv1536806402:86 , srv1734284930:86 , srv1801344619:86 , srv1981029995:86 , srv2035298398:86 , srv272807779:86 , srv398482126:86 , srv430388506:86 , srv550037804:86 , srv615336567:86 , srv624535691:86 , srv924322301:86 , srv955106368:86 , srv97672954:86 , srv1014124650:87 , srv1228377288:87 , srv1330431968:87 , srv1551231185:87 , srv1563433169:87 , srv177867414:87 , srv1847080810:87 , srv2068462148:87 , srv273251182:87 , srv292871290:87 , srv324576078:87 , srv35820367:87 , srv592812774:87 , srv59672583:87 , srv70068510:87 , srv806923764:87 , srv822804968:87 , srv825935605:87 , srv84330380:87 , srv974645998:87 , srv1068329525:88 , srv1074376144:88 , srv1506531956:88 , srv1548495508:88 , srv1581098756:88 , srv1733145613:88 , srv1784468462:88 , srv1816133462:88 , srv593412587:88 , srv678393378:88 , srv724738355:88 , srv786312605:88 , srv100709408:89 , srv1178105884:89 , srv2145704335:89 , srv228193877:89 , srv321120668:89 , srv585459578:89 , srv802482686:89 , srv1505795139:90 , srv1718786812:90 , srv368252531:90 , srv1530098624:91 , srv1660851556:92 , srv2107281793:93 , srv1472946981:95 , srv85285216:440 }
2023-04-05 09:56:47,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:47,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:47,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:47,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:47,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:47,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:47,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:47,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:47,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:47,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:47,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:47,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03935823873699589, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057505184463486195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03935823873699589, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:47,326 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 09:56:47,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1760548320830538, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03935823873699589, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057505184463486195, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03935823873699589, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 09:56:47,720 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 589 ms to try 5000 different iterations.  Found a solution that moves 2659 regions; Going from a computed imbalance of 0.1760548320830538 to a new imbalance of 0.013448410208543484. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022058883436071514); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03654556063661726, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29544444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022058883436071514); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04033333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:47,732 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1530098624:79 , srv1718786812:79 , srv1660851556:80 , srv2107281793:80 , srv1068329525:81 , srv2145704335:81 , srv724738355:81 , srv1178105884:82 , srv1472946981:82 , srv321120668:82 , srv368252531:82 , srv822804968:82 , srv100709408:83 , srv1074376144:83 , srv1350483096:83 , srv1733145613:83 , srv1816133462:83 , srv228193877:83 , srv585459578:83 , srv678393378:83 , srv786312605:83 , srv1173593158:84 , srv1506531956:84 , srv1548495508:84 , srv1581098756:84 , srv615336567:84 , srv802482686:84 , srv974645998:84 , srv1104142993:85 , srv1228377288:85 , srv1505795139:85 , srv1536806402:85 , srv1563433169:85 , srv1784468462:85 , srv1847080810:85 , srv1939903100:85 , srv1981029995:85 , srv324576078:85 , srv35820367:85 , srv479793082:85 , srv592812774:85 , srv593412587:85 , srv70068510:85 , srv84330380:85 , srv899649383:85 , srv924322301:85 , srv97672954:85 , srv1014124650:86 , srv1182298482:86 , srv1266216833:86 , srv1330431968:86 , srv1551502678:86 , srv1734284930:86 , srv1768890086:86 , srv177867414:86 , srv1801344619:86 , srv2035298398:86 , srv234698941:86 , srv272807779:86 , srv273251182:86 , srv482786853:86 , srv59672583:86 , srv624535691:86 , srv816758156:86 , srv825935605:86 , srv983444459:86 , srv1113275606:87 , srv1384245980:87 , srv1551231185:87 , srv1903346204:87 , srv292871290:87 , srv38950898:87 , srv398482126:87 , srv550037804:87 , srv553023578:87 , srv698063360:87 , srv701847163:87 , srv806923764:87 , srv1034850280:88 , srv1332573754:88 , srv151820341:88 , srv1525189139:88 , srv2068462148:88 , srv262672817:88 , srv430388506:88 , srv490169728:88 , srv858003230:88 , srv955106368:88 , srv119021754:89 , srv199650130:89 , srv290475471:89 , srv447703162:89 , srv805494408:89 , srv1461398210:90 , srv837088425:90 , srv1191055467:91 , srv1931258776:91 , srv1900113941:92 , srv1935417005:92 , srv85285216:530 }
2023-04-05 09:56:47,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:47,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:47,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:47,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:47,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:47,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:47,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:47,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:47,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:47,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022058883436071514); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03654556063661726, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022058883436071514); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04033333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:47,972 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 09:56:47,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013429791492597687, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022058883436071514); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03654556063661726, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022058883436071514); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04033333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 09:56:48,346 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 546 ms to try 5000 different iterations.  Found a solution that moves 912 regions; Going from a computed imbalance of 0.013429791492597687 to a new imbalance of 8.356215776631934E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011019827045069933); MoveCostFunction : (multiplier=7.0, imbalance=0.10133333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:48,349 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1472946981:81 , srv1505795139:82 , srv1191055467:83 , srv177867414:83 , srv1900113941:83 , srv1935417005:83 , srv2068462148:83 , srv955106368:83 , srv1014124650:84 , srv1034850280:84 , srv1384245980:84 , srv1551231185:84 , srv1784468462:84 , srv1847080810:84 , srv1931258776:84 , srv273251182:84 , srv290475471:84 , srv292871290:84 , srv398482126:84 , srv430388506:84 , srv490169728:84 , srv59672583:84 , srv805494408:84 , srv806923764:84 , srv825935605:84 , srv837088425:84 , srv858003230:84 , srv119021754:85 , srv1228377288:85 , srv1330431968:85 , srv1332573754:85 , srv1461398210:85 , srv1525189139:85 , srv1563433169:85 , srv1581098756:85 , srv1660851556:85 , srv1734284930:85 , srv1801344619:85 , srv2035298398:85 , srv2107281793:85 , srv228193877:85 , srv272807779:85 , srv324576078:85 , srv35820367:85 , srv368252531:85 , srv38950898:85 , srv447703162:85 , srv550037804:85 , srv585459578:85 , srv592812774:85 , srv593412587:85 , srv698063360:85 , srv70068510:85 , srv802482686:85 , srv84330380:85 , srv983444459:85 , srv1113275606:86 , srv1506531956:86 , srv151820341:86 , srv1536806402:86 , srv1548495508:86 , srv1903346204:86 , srv199650130:86 , srv2145704335:86 , srv234698941:86 , srv262672817:86 , srv321120668:86 , srv553023578:86 , srv624535691:86 , srv701847163:86 , srv786312605:86 , srv974645998:86 , srv97672954:86 , srv100709408:87 , srv1074376144:87 , srv1104142993:87 , srv1173593158:87 , srv1178105884:87 , srv1266216833:87 , srv1551502678:87 , srv1768890086:87 , srv1939903100:87 , srv1981029995:87 , srv482786853:87 , srv615336567:87 , srv678393378:87 , srv899649383:87 , srv924322301:87 , srv1068329525:88 , srv1182298482:88 , srv1350483096:88 , srv1530098624:88 , srv1733145613:88 , srv1816133462:88 , srv479793082:88 , srv724738355:88 , srv816758156:88 , srv822804968:88 , srv1718786812:89 , srv85285216:542 }
2023-04-05 09:56:48,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:48,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:48,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:48,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:48,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:48,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:48,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:48,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:48,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:48,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:48,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:48,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:48,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:48,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:48,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:48,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:48,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011019827045069933); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:48,515 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 09:56:48,515 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.292356171733229E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006104220173631566); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011019827045069933); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006104220173631566); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 09:56:48,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 385 ms to try 5000 different iterations.  Found a solution that moves 252 regions; Going from a computed imbalance of 8.292356171733229E-4 to a new imbalance of 3.5842358127510076E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.028, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:48,802 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv100709408:83 , srv1074376144:83 , srv1718786812:83 , srv1733145613:83 , srv837088425:83 , srv1104142993:84 , srv1173593158:84 , srv1178105884:84 , srv1182298482:84 , srv1266216833:84 , srv1330431968:84 , srv1332573754:84 , srv1472946981:84 , srv1506531956:84 , srv1530098624:84 , srv1548495508:84 , srv1551502678:84 , srv1768890086:84 , srv1784468462:84 , srv1816133462:84 , srv1900113941:84 , srv1903346204:84 , srv1935417005:84 , srv1981029995:84 , srv2035298398:84 , srv2068462148:84 , srv2107281793:84 , srv262672817:84 , srv290475471:84 , srv292871290:84 , srv324576078:84 , srv430388506:84 , srv479793082:84 , srv482786853:84 , srv550037804:84 , srv593412587:84 , srv624535691:84 , srv678393378:84 , srv701847163:84 , srv802482686:84 , srv805494408:84 , srv806923764:84 , srv816758156:84 , srv822804968:84 , srv924322301:84 , srv955106368:84 , srv1014124650:85 , srv1034850280:85 , srv1068329525:85 , srv1113275606:85 , srv119021754:85 , srv1191055467:85 , srv1228377288:85 , srv1350483096:85 , srv1384245980:85 , srv1461398210:85 , srv1505795139:85 , srv151820341:85 , srv1525189139:85 , srv1536806402:85 , srv1551231185:85 , srv1563433169:85 , srv1581098756:85 , srv1660851556:85 , srv1734284930:85 , srv1801344619:85 , srv1847080810:85 , srv1931258776:85 , srv1939903100:85 , srv199650130:85 , srv228193877:85 , srv234698941:85 , srv272807779:85 , srv273251182:85 , srv321120668:85 , srv35820367:85 , srv368252531:85 , srv38950898:85 , srv398482126:85 , srv447703162:85 , srv490169728:85 , srv553023578:85 , srv585459578:85 , srv59672583:85 , srv698063360:85 , srv70068510:85 , srv786312605:85 , srv825935605:85 , srv84330380:85 , srv858003230:85 , srv899649383:85 , srv974645998:85 , srv177867414:86 , srv2145704335:86 , srv592812774:86 , srv615336567:86 , srv724738355:86 , srv97672954:86 , srv983444459:86 , srv85285216:629 }
2023-04-05 09:56:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:48,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:48,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:48,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:48,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:48,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:48,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:48,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:48,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:48,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:48,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:48,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:48,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:48,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:48,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:48,941 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 09:56:48,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.407781641320378E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 09:56:49,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 371 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.407781641320378E-5 to a new imbalance of 8.175750307519066E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:49,203 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1113275606:83 , srv1182298482:83 , srv1461398210:83 , srv1525189139:83 , srv1551231185:83 , srv1816133462:83 , srv553023578:83 , srv592812774:83 , srv615336567:83 , srv724738355:83 , srv97672954:83 , srv100709408:84 , srv1014124650:84 , srv1034850280:84 , srv1068329525:84 , srv1104142993:84 , srv1178105884:84 , srv119021754:84 , srv1191055467:84 , srv1228377288:84 , srv1266216833:84 , srv1330431968:84 , srv1332573754:84 , srv1350483096:84 , srv1384245980:84 , srv1472946981:84 , srv1505795139:84 , srv1506531956:84 , srv151820341:84 , srv1530098624:84 , srv1536806402:84 , srv1548495508:84 , srv1551502678:84 , srv1563433169:84 , srv1581098756:84 , srv1660851556:84 , srv1733145613:84 , srv1734284930:84 , srv1768890086:84 , srv177867414:84 , srv1801344619:84 , srv1900113941:84 , srv1903346204:84 , srv1931258776:84 , srv1939903100:84 , srv1981029995:84 , srv199650130:84 , srv2068462148:84 , srv2107281793:84 , srv2145704335:84 , srv228193877:84 , srv234698941:84 , srv262672817:84 , srv272807779:84 , srv273251182:84 , srv290475471:84 , srv292871290:84 , srv321120668:84 , srv35820367:84 , srv368252531:84 , srv38950898:84 , srv398482126:84 , srv430388506:84 , srv447703162:84 , srv479793082:84 , srv482786853:84 , srv490169728:84 , srv550037804:84 , srv585459578:84 , srv593412587:84 , srv59672583:84 , srv624535691:84 , srv678393378:84 , srv698063360:84 , srv70068510:84 , srv701847163:84 , srv786312605:84 , srv802482686:84 , srv805494408:84 , srv806923764:84 , srv816758156:84 , srv825935605:84 , srv837088425:84 , srv84330380:84 , srv858003230:84 , srv899649383:84 , srv924322301:84 , srv974645998:84 , srv983444459:84 , srv1074376144:85 , srv1173593158:85 , srv1718786812:85 , srv1784468462:85 , srv1847080810:85 , srv1935417005:85 , srv2035298398:85 , srv324576078:85 , srv822804968:85 , srv955106368:85 , srv85285216:685 }
2023-04-05 09:56:49,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:49,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1903346204=42, srv228193877=52, srv1801344619=38, srv593412587=74, srv678393378=78, srv2068462148=49, srv983444459=99, srv585459578=72, srv1505795139=20, srv1981029995=46, srv490169728=69, srv1548495508=26, srv97672954=98, srv1173593158=7, srv724738355=82, srv837088425=90, srv974645998=97, srv119021754=10, srv1191055467=11, srv35820367=61, srv806923764=86, srv2107281793=50, srv100709408=0, srv1551502678=28, srv292871290=58, srv368252531=62, srv1384245980=17, srv1178105884=8, srv1816133462=39, srv1551231185=27, srv84330380=91, srv1847080810=40, srv1563433169=29, srv2145704335=51, srv447703162=66, srv1330431968=14, srv1472946981=19, srv1935417005=44, srv479793082=67, srv1784468462=37, srv1332573754=15, srv899649383=94, srv482786853=68, srv70068510=80, srv701847163=81, srv1939903100=45, srv698063360=79, srv59672583=75, srv1266216833=13, srv1104142993=5, srv1530098624=24, srv1525189139=23, srv1733145613=33, srv786312605=83, srv85285216=92, srv858003230=93, srv1034850280=2, srv1900113941=41, srv262672817=54, srv924322301=95, srv1734284930=34, srv805494408=85, srv321120668=59, srv38950898=63, srv290475471=57, srv177867414=36, srv1718786812=32, srv199650130=47, srv1350483096=16, srv273251182=56, srv816758156=87, srv430388506=65, srv615336567=76, srv1074376144=4, srv1660851556=31, srv398482126=64, srv592812774=73, srv1228377288=12, srv1068329525=3, srv1768890086=35, srv822804968=88, srv1113275606=6, srv2035298398=48, srv1182298482=9, srv151820341=22, srv234698941=53, srv1536806402=25, srv550037804=70, srv553023578=71, srv802482686=84, srv1581098756=30, srv324576078=60, srv1931258776=43, srv825935605=89, srv1014124650=1, srv272807779=55, srv1506531956=21, srv1461398210=18, srv624535691=77, srv955106368=96} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:49,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:49,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 09:56:49,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 09:56:49,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 09:56:49,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 09:56:49,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 09:56:49,334 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:49,335 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1113275606:83 , srv1182298482:83 , srv1461398210:83 , srv1525189139:83 , srv1551231185:83 , srv1816133462:83 , srv553023578:83 , srv592812774:83 , srv615336567:83 , srv724738355:83 , srv97672954:83 , srv100709408:84 , srv1014124650:84 , srv1034850280:84 , srv1068329525:84 , srv1104142993:84 , srv1178105884:84 , srv119021754:84 , srv1191055467:84 , srv1228377288:84 , srv1266216833:84 , srv1330431968:84 , srv1332573754:84 , srv1350483096:84 , srv1384245980:84 , srv1472946981:84 , srv1505795139:84 , srv1506531956:84 , srv151820341:84 , srv1530098624:84 , srv1536806402:84 , srv1548495508:84 , srv1551502678:84 , srv1563433169:84 , srv1581098756:84 , srv1660851556:84 , srv1733145613:84 , srv1734284930:84 , srv1768890086:84 , srv177867414:84 , srv1801344619:84 , srv1900113941:84 , srv1903346204:84 , srv1931258776:84 , srv1939903100:84 , srv1981029995:84 , srv199650130:84 , srv2068462148:84 , srv2107281793:84 , srv2145704335:84 , srv228193877:84 , srv234698941:84 , srv262672817:84 , srv272807779:84 , srv273251182:84 , srv290475471:84 , srv292871290:84 , srv321120668:84 , srv35820367:84 , srv368252531:84 , srv38950898:84 , srv398482126:84 , srv430388506:84 , srv447703162:84 , srv479793082:84 , srv482786853:84 , srv490169728:84 , srv550037804:84 , srv585459578:84 , srv593412587:84 , srv59672583:84 , srv624535691:84 , srv678393378:84 , srv698063360:84 , srv70068510:84 , srv701847163:84 , srv786312605:84 , srv802482686:84 , srv805494408:84 , srv806923764:84 , srv816758156:84 , srv825935605:84 , srv837088425:84 , srv84330380:84 , srv858003230:84 , srv899649383:84 , srv924322301:84 , srv974645998:84 , srv983444459:84 , srv1074376144:85 , srv1173593158:85 , srv1718786812:85 , srv1784468462:85 , srv1847080810:85 , srv1935417005:85 , srv2035298398:85 , srv324576078:85 , srv822804968:85 , srv955106368:85 , srv85285216:685 }
2023-04-05 09:56:49,361 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=1575 (was 2068)
2023-04-05 09:56:49,369 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=169, AvailableMemoryMB=1575
2023-04-05 09:56:49,370 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 09:56:49,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-05 09:56:49,383 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1025473256:84 , srv1043406272:84 , srv1068856100:84 , srv1103826761:84 , srv1140165754:84 , srv1243973664:84 , srv1324643331:84 , srv1329352177:84 , srv1351376508:84 , srv1501571115:84 , srv151486627:84 , srv1551436904:84 , srv1639484670:84 , srv1658531484:84 , srv1668038884:84 , srv1688902502:84 , srv1736066287:84 , srv1830499377:84 , srv18604092:84 , srv1888677540:84 , srv198016080:84 , srv275010702:84 , srv301607355:84 , srv416070105:84 , srv643124328:84 , srv817420508:84 , srv897809866:84 , srv942321313:84 , srv995500497:84 , srv840423328:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-05 09:56:49,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:56:49,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688902502=15, srv817420508=25, srv1351376508=8, srv1639484670=12, srv897809866=27, srv1736066287=16, srv942321313=28, srv151486627=10, srv1658531484=13, srv995500497=29, srv1551436904=11, srv1668038884=14, srv1830499377=17, srv1140165754=4, srv1025473256=0, srv1103826761=3, srv1243973664=5, srv275010702=21, srv416070105=23, srv301607355=22, srv198016080=20, srv1068856100=2, srv1043406272=1, srv840423328=26, srv1501571115=9, srv1888677540=19, srv18604092=18, srv1329352177=7, srv643124328=24, srv1324643331=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:56:49,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:56:49,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:56:49,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 09:56:49,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0614607490607262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:56:49,422 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912386704077694, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0614607490607262, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-05 09:58:49,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5948232 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912386704077694 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:58:49,412 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1025473256:90 , srv1043406272:90 , srv1068856100:90 , srv1103826761:90 , srv1140165754:90 , srv1243973664:90 , srv1324643331:90 , srv1329352177:90 , srv1351376508:90 , srv1501571115:90 , srv151486627:90 , srv1551436904:90 , srv1639484670:90 , srv1658531484:90 , srv1668038884:90 , srv1688902502:90 , srv1736066287:90 , srv1830499377:90 , srv18604092:90 , srv1888677540:90 , srv198016080:90 , srv275010702:90 , srv301607355:90 , srv416070105:90 , srv643124328:90 , srv817420508:90 , srv840423328:90 , srv897809866:90 , srv942321313:90 , srv995500497:90 }
2023-04-05 09:58:49,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 09:58:49,414 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1688902502=15, srv817420508=25, srv1351376508=8, srv1639484670=12, srv897809866=27, srv1736066287=16, srv942321313=28, srv151486627=10, srv1658531484=13, srv995500497=29, srv1551436904=11, srv1668038884=14, srv1830499377=17, srv1140165754=4, srv1025473256=0, srv1103826761=3, srv1243973664=5, srv275010702=21, srv416070105=23, srv301607355=22, srv198016080=20, srv1068856100=2, srv1043406272=1, srv840423328=26, srv1501571115=9, srv1888677540=19, srv18604092=18, srv1329352177=7, srv643124328=24, srv1324643331=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 09:58:49,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 09:58:49,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 09:58:49,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 09:58:49,430 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1025473256:90 , srv1043406272:90 , srv1068856100:90 , srv1103826761:90 , srv1140165754:90 , srv1243973664:90 , srv1324643331:90 , srv1329352177:90 , srv1351376508:90 , srv1501571115:90 , srv151486627:90 , srv1551436904:90 , srv1639484670:90 , srv1658531484:90 , srv1668038884:90 , srv1688902502:90 , srv1736066287:90 , srv1830499377:90 , srv18604092:90 , srv1888677540:90 , srv198016080:90 , srv275010702:90 , srv301607355:90 , srv416070105:90 , srv643124328:90 , srv817420508:90 , srv840423328:90 , srv897809866:90 , srv942321313:90 , srv995500497:90 }
2023-04-05 09:58:49,445 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 340), ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1846 (was 1575) - AvailableMemoryMB LEAK? -