2023-04-25 06:55:47,816 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-25 06:55:48,220 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-25 06:55:48,360 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-25 06:55:48,444 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 06:55:48,454 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 06:55:48,472 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=395, ProcessCount=172, AvailableMemoryMB=5015
2023-04-25 06:55:48,475 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 06:55:48,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 06:55:48,639 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1052218515:84 , srv1086076688:84 , srv1091450040:84 , srv1092645485:84 , srv1104887274:84 , srv1119291885:84 , srv1166149677:84 , srv1187144335:84 , srv1238673160:84 , srv1247592332:84 , srv1250742313:84 , srv1258191175:84 , srv1266980170:84 , srv127946077:84 , srv1279945499:84 , srv1287205564:84 , srv1287709632:84 , srv1290116651:84 , srv1290407093:84 , srv1316284004:84 , srv1324788525:84 , srv1325046171:84 , srv1325141305:84 , srv1330727546:84 , srv1364930815:84 , srv1365198058:84 , srv1384291071:84 , srv1406614963:84 , srv1446147626:84 , srv1449848231:84 , srv1487510455:84 , srv150580344:84 , srv1521823679:84 , srv1522635267:84 , srv1541407839:84 , srv1555451869:84 , srv1638716054:84 , srv1682749505:84 , srv1697414305:84 , srv1716074008:84 , srv1716724687:84 , srv1822080257:84 , srv1831681666:84 , srv1856001850:84 , srv1891038351:84 , srv1892198918:84 , srv1895502545:84 , srv1911367942:84 , srv1926683551:84 , srv1945545398:84 , srv195489667:84 , srv1967040574:84 , srv19768057:84 , srv1985796979:84 , srv2015358469:84 , srv2039889804:84 , srv2049873547:84 , srv2053034767:84 , srv2090525733:84 , srv2100155876:84 , srv2114117724:84 , srv2128242560:84 , srv2134061923:84 , srv226822357:84 , srv23364482:84 , srv237652:84 , srv241856861:84 , srv24950125:84 , srv307148287:84 , srv323790842:84 , srv355224440:84 , srv383554850:84 , srv388009322:84 , srv440334870:84 , srv454591214:84 , srv463192354:84 , srv484012113:84 , srv485663655:84 , srv4945022:84 , srv543826990:84 , srv598733865:84 , srv655203070:84 , srv655262046:84 , srv672057482:84 , srv673860922:84 , srv692090419:84 , srv709968368:84 , srv753633250:84 , srv760428101:84 , srv78088430:84 , srv78848275:84 , srv803689441:84 , srv863559754:84 , srv864299521:84 , srv877990007:84 , srv931980804:84 , srv938322452:84 , srv943983348:84 , srv969866293:84 , srv1825502222:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-25 06:55:48,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:48,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:48,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:48,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:48,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:48,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:48,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:48,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:48,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:48,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:48,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:48,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:48,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:48,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:48,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:48,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:48,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:48,975 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:48,975 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 06:55:48,976 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 06:55:49,296 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 475 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18475715808270018. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04050498053401402, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05558181197722107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04050498053401402, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:49,315 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1521823679:81 , srv1287709632:82 , srv1446147626:82 , srv1052218515:83 , srv1086076688:83 , srv1187144335:83 , srv1487510455:83 , srv1697414305:83 , srv1895502545:83 , srv19768057:83 , srv2134061923:83 , srv1119291885:84 , srv1238673160:84 , srv1250742313:84 , srv1449848231:84 , srv1911367942:84 , srv2053034767:84 , srv2090525733:84 , srv307148287:84 , srv383554850:84 , srv454591214:84 , srv709968368:84 , srv863559754:84 , srv877990007:84 , srv1287205564:85 , srv1290407093:85 , srv1316284004:85 , srv1325046171:85 , srv1364930815:85 , srv1365198058:85 , srv1384291071:85 , srv1541407839:85 , srv1945545398:85 , srv237652:85 , srv388009322:85 , srv4945022:85 , srv931980804:85 , srv943983348:85 , srv969866293:85 , srv1092645485:86 , srv1104887274:86 , srv1258191175:86 , srv150580344:86 , srv1555451869:86 , srv1682749505:86 , srv1892198918:86 , srv195489667:86 , srv2100155876:86 , srv2114117724:86 , srv226822357:86 , srv355224440:86 , srv463192354:86 , srv598733865:86 , srv672057482:86 , srv673860922:86 , srv753633250:86 , srv78848275:86 , srv938322452:86 , srv1166149677:87 , srv1266980170:87 , srv1279945499:87 , srv1330727546:87 , srv1406614963:87 , srv1716074008:87 , srv1716724687:87 , srv1822080257:87 , srv1967040574:87 , srv2049873547:87 , srv241856861:87 , srv655203070:87 , srv760428101:87 , srv864299521:87 , srv1091450040:88 , srv1290116651:88 , srv1325141305:88 , srv1638716054:88 , srv1831681666:88 , srv1926683551:88 , srv2128242560:88 , srv23364482:88 , srv24950125:88 , srv323790842:88 , srv692090419:88 , srv1247592332:89 , srv1856001850:89 , srv2039889804:89 , srv655262046:89 , srv1324788525:90 , srv485663655:90 , srv1522635267:91 , srv1985796979:91 , srv484012113:91 , srv543826990:91 , srv78088430:91 , srv1891038351:92 , srv2015358469:92 , srv803689441:92 , srv440334870:93 , srv127946077:94 , srv1825502222:450 }
2023-04-25 06:55:49,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:49,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:49,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:49,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:49,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:49,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:49,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:49,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:49,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:49,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:49,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:49,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:49,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:49,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:49,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:49,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:49,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:49,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:49,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:49,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:49,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:49,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:49,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:49,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:49,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:49,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:49,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:49,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:49,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:49,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:49,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:49,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:49,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:49,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:49,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:49,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:49,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:49,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:49,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:49,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:49,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:49,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:49,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:49,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:49,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:49,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:49,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:49,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:49,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:49,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:49,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:49,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:49,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:49,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:49,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:49,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:49,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04050498053401402, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05558181197722107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04050498053401402, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:49,582 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 06:55:49,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18472436001369297, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04050498053401402, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05558181197722107, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04050498053401402, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17991666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 06:55:49,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 549 ms to try 5000 different iterations.  Found a solution that moves 2666 regions; Going from a computed imbalance of 0.18472436001369297 to a new imbalance of 0.01544055870562453. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02162151039900211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03456641811793534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2962222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02162151039900211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:49,982 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv803689441:78 , srv127946077:79 , srv484012113:79 , srv2015358469:80 , srv440334870:80 , srv1891038351:81 , srv1324788525:82 , srv1522635267:82 , srv1985796979:82 , srv2039889804:82 , srv485663655:82 , srv543826990:82 , srv78088430:82 , srv1166149677:83 , srv1238673160:83 , srv1279945499:83 , srv1330727546:83 , srv1831681666:83 , srv1104887274:84 , srv1247592332:84 , srv1325141305:84 , srv1406614963:84 , srv1638716054:84 , srv1716074008:84 , srv1716724687:84 , srv1822080257:84 , srv2049873547:84 , srv323790842:84 , srv655262046:84 , srv78848275:84 , srv931980804:84 , srv1092645485:85 , srv1258191175:85 , srv1287205564:85 , srv1290407093:85 , srv1316284004:85 , srv1856001850:85 , srv1892198918:85 , srv1926683551:85 , srv2100155876:85 , srv226822357:85 , srv23364482:85 , srv355224440:85 , srv388009322:85 , srv463192354:85 , srv4945022:85 , srv598733865:85 , srv692090419:85 , srv753633250:85 , srv864299521:85 , srv943983348:85 , srv1091450040:86 , srv1266980170:86 , srv1290116651:86 , srv1541407839:86 , srv1945545398:86 , srv1967040574:86 , srv2114117724:86 , srv2128242560:86 , srv24950125:86 , srv655203070:86 , srv672057482:86 , srv673860922:86 , srv1119291885:87 , srv1555451869:87 , srv2053034767:87 , srv241856861:87 , srv307148287:87 , srv383554850:87 , srv454591214:87 , srv760428101:87 , srv938322452:87 , srv1187144335:88 , srv1250742313:88 , srv1364930815:88 , srv1365198058:88 , srv1487510455:88 , srv1682749505:88 , srv19768057:88 , srv1052218515:89 , srv1325046171:89 , srv1384291071:89 , srv1446147626:89 , srv1449848231:89 , srv1911367942:89 , srv2134061923:89 , srv237652:89 , srv969866293:89 , srv1521823679:90 , srv1697414305:90 , srv1895502545:90 , srv195489667:90 , srv2090525733:90 , srv709968368:90 , srv863559754:90 , srv1086076688:91 , srv1287709632:91 , srv150580344:91 , srv877990007:91 , srv1825502222:516 }
2023-04-25 06:55:49,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:49,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:50,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:50,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:50,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:50,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:50,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:50,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:50,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:50,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:50,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:50,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:50,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:50,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:50,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:50,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:50,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:50,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:50,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:50,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02162151039900211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03456641811793534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02162151039900211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:50,158 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 06:55:50,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015421890974631114, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02162151039900211); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03456641811793534, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02162151039900211); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012333333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 06:55:50,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 505 ms to try 5000 different iterations.  Found a solution that moves 971 regions; Going from a computed imbalance of 0.015421890974631114 to a new imbalance of 4.445657149323704E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007573886787341408); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010814215194852728); MoveCostFunction : (multiplier=7.0, imbalance=0.1078888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007573886787341408); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:50,535 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv150580344:80 , srv195489667:81 , srv1091450040:82 , srv237652:82 , srv877990007:82 , srv1086076688:83 , srv1325046171:83 , srv1384291071:83 , srv1555451869:83 , srv1638716054:83 , srv1682749505:83 , srv1697414305:83 , srv1856001850:83 , srv1895502545:83 , srv2128242560:83 , srv241856861:83 , srv709968368:83 , srv760428101:83 , srv1287709632:84 , srv1364930815:84 , srv1926683551:84 , srv2090525733:84 , srv24950125:84 , srv440334870:84 , srv543826990:84 , srv655262046:84 , srv692090419:84 , srv78088430:84 , srv969866293:84 , srv1052218515:85 , srv1247592332:85 , srv1250742313:85 , srv1266980170:85 , srv127946077:85 , srv1324788525:85 , srv1325141305:85 , srv1365198058:85 , srv1449848231:85 , srv1891038351:85 , srv1967040574:85 , srv1985796979:85 , srv2015358469:85 , srv2039889804:85 , srv2053034767:85 , srv23364482:85 , srv323790842:85 , srv655203070:85 , srv673860922:85 , srv863559754:85 , srv864299521:85 , srv938322452:85 , srv1166149677:86 , srv1290116651:86 , srv1316284004:86 , srv1330727546:86 , srv1406614963:86 , srv1446147626:86 , srv1521823679:86 , srv1522635267:86 , srv1541407839:86 , srv1716724687:86 , srv1831681666:86 , srv1892198918:86 , srv1911367942:86 , srv1945545398:86 , srv19768057:86 , srv2100155876:86 , srv2114117724:86 , srv2134061923:86 , srv226822357:86 , srv355224440:86 , srv383554850:86 , srv485663655:86 , srv672057482:86 , srv753633250:86 , srv803689441:86 , srv1092645485:87 , srv1104887274:87 , srv1119291885:87 , srv1187144335:87 , srv1258191175:87 , srv1487510455:87 , srv1716074008:87 , srv1822080257:87 , srv2049873547:87 , srv454591214:87 , srv463192354:87 , srv484012113:87 , srv4945022:87 , srv598733865:87 , srv78848275:87 , srv943983348:87 , srv1279945499:88 , srv1287205564:88 , srv1290407093:88 , srv307148287:88 , srv931980804:88 , srv388009322:89 , srv1238673160:90 , srv1825502222:559 }
2023-04-25 06:55:50,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:50,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:50,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:50,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:50,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:50,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:50,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:50,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:50,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:50,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:50,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:50,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:50,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:50,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:50,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:50,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:50,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007573886787341408); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010814215194852728); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007573886787341408); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:50,731 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 06:55:50,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.3776662761256323E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007573886787341408); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010814215194852728); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007573886787341408); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 06:55:51,095 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 498 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 4.3776662761256323E-4 to a new imbalance of 5.031618546385776E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:51,096 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1290116651:83 , srv1290407093:83 , srv1522635267:83 , srv1911367942:83 , srv307148287:83 , srv388009322:83 , srv1092645485:84 , srv1119291885:84 , srv1187144335:84 , srv1247592332:84 , srv1250742313:84 , srv1258191175:84 , srv1266980170:84 , srv127946077:84 , srv1279945499:84 , srv1365198058:84 , srv1487510455:84 , srv1716074008:84 , srv1891038351:84 , srv1926683551:84 , srv195489667:84 , srv1967040574:84 , srv1985796979:84 , srv2090525733:84 , srv2100155876:84 , srv2114117724:84 , srv2134061923:84 , srv23364482:84 , srv24950125:84 , srv323790842:84 , srv440334870:84 , srv454591214:84 , srv463192354:84 , srv485663655:84 , srv4945022:84 , srv655203070:84 , srv672057482:84 , srv863559754:84 , srv938322452:84 , srv969866293:84 , srv1052218515:85 , srv1086076688:85 , srv1104887274:85 , srv1238673160:85 , srv1287205564:85 , srv1324788525:85 , srv1325046171:85 , srv1325141305:85 , srv1364930815:85 , srv1384291071:85 , srv1406614963:85 , srv1446147626:85 , srv1449848231:85 , srv150580344:85 , srv1521823679:85 , srv1541407839:85 , srv1682749505:85 , srv1716724687:85 , srv1822080257:85 , srv1831681666:85 , srv1856001850:85 , srv1892198918:85 , srv1895502545:85 , srv1945545398:85 , srv19768057:85 , srv2015358469:85 , srv2049873547:85 , srv2128242560:85 , srv226822357:85 , srv355224440:85 , srv383554850:85 , srv484012113:85 , srv543826990:85 , srv598733865:85 , srv655262046:85 , srv673860922:85 , srv692090419:85 , srv709968368:85 , srv753633250:85 , srv760428101:85 , srv78088430:85 , srv78848275:85 , srv864299521:85 , srv877990007:85 , srv931980804:85 , srv943983348:85 , srv1091450040:86 , srv1166149677:86 , srv1287709632:86 , srv1316284004:86 , srv1330727546:86 , srv1555451869:86 , srv1697414305:86 , srv2039889804:86 , srv2053034767:86 , srv237652:86 , srv241856861:86 , srv803689441:86 , srv1638716054:87 , srv1825502222:617 }
2023-04-25 06:55:51,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:51,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:51,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:51,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:51,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:51,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:51,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:51,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:51,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:51,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:51,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:51,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:51,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:51,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:51,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:51,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:51,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:51,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:51,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:51,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:51,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:51,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:51,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:51,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:51,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:51,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:51,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:51,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:51,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:51,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:51,313 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 06:55:51,314 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.85866544978512E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 06:55:51,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 412 ms to try 5000 different iterations.  Found a solution that moves 43 regions; Going from a computed imbalance of 4.85866544978512E-5 to a new imbalance of 4.5664162168907945E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=9.475587393582687E-4); MoveCostFunction : (multiplier=7.0, imbalance=0.0047777777777777775); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:51,589 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1287205564:83 , srv1287709632:83 , srv1290116651:83 , srv1449848231:83 , srv1822080257:83 , srv2049873547:83 , srv241856861:83 , srv598733865:83 , srv863559754:83 , srv1052218515:84 , srv1086076688:84 , srv1091450040:84 , srv1092645485:84 , srv1104887274:84 , srv1119291885:84 , srv1166149677:84 , srv1187144335:84 , srv1238673160:84 , srv1247592332:84 , srv1258191175:84 , srv1266980170:84 , srv127946077:84 , srv1279945499:84 , srv1316284004:84 , srv1324788525:84 , srv1325046171:84 , srv1325141305:84 , srv1330727546:84 , srv1364930815:84 , srv1365198058:84 , srv1384291071:84 , srv1406614963:84 , srv1446147626:84 , srv1487510455:84 , srv150580344:84 , srv1521823679:84 , srv1522635267:84 , srv1541407839:84 , srv1555451869:84 , srv1638716054:84 , srv1682749505:84 , srv1697414305:84 , srv1716074008:84 , srv1716724687:84 , srv1831681666:84 , srv1856001850:84 , srv1891038351:84 , srv1892198918:84 , srv1911367942:84 , srv1945545398:84 , srv1967040574:84 , srv19768057:84 , srv1985796979:84 , srv2015358469:84 , srv2039889804:84 , srv2053034767:84 , srv2090525733:84 , srv2114117724:84 , srv2128242560:84 , srv2134061923:84 , srv226822357:84 , srv23364482:84 , srv237652:84 , srv24950125:84 , srv307148287:84 , srv355224440:84 , srv383554850:84 , srv388009322:84 , srv454591214:84 , srv463192354:84 , srv484012113:84 , srv485663655:84 , srv543826990:84 , srv655203070:84 , srv655262046:84 , srv672057482:84 , srv673860922:84 , srv692090419:84 , srv709968368:84 , srv753633250:84 , srv760428101:84 , srv78088430:84 , srv78848275:84 , srv803689441:84 , srv864299521:84 , srv877990007:84 , srv931980804:84 , srv938322452:84 , srv943983348:84 , srv969866293:84 , srv1250742313:85 , srv1290407093:85 , srv1895502545:85 , srv1926683551:85 , srv195489667:85 , srv2100155876:85 , srv323790842:85 , srv440334870:85 , srv4945022:85 , srv1825502222:684 }
2023-04-25 06:55:51,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:51,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv692090419=86, srv709968368=87, srv1945545398=50, srv195489667=51, srv1638716054=36, srv1831681666=43, srv323790842=70, srv1406614963=27, srv753633250=88, srv1187144335=7, srv127946077=13, srv1487510455=30, srv1104887274=4, srv1716074008=39, srv1266980170=12, srv383554850=72, srv2049873547=57, srv943983348=98, srv1287205564=15, srv484012113=77, srv1052218515=0, srv4945022=79, srv1290116651=17, srv1449848231=29, srv1092645485=3, srv1247592332=9, srv226822357=64, srv23364482=65, srv1086076688=1, srv1258191175=11, srv2053034767=58, srv78848275=91, srv1250742313=10, srv598733865=81, srv454591214=75, srv1166149677=6, srv969866293=99, srv1446147626=28, srv19768057=53, srv1926683551=49, srv237652=66, srv440334870=74, srv241856861=67, srv1522635267=33, srv355224440=71, srv1967040574=52, srv463192354=76, srv1856001850=44, srv1541407839=34, srv2114117724=61, srv1555451869=35, srv2100155876=60, srv1287709632=16, srv1365198058=25, srv388009322=73, srv1892198918=46, srv307148287=69, srv1716724687=40, srv1238673160=8, srv803689441=92, srv1364930815=24, srv1325046171=21, srv150580344=31, srv1822080257=41, srv1324788525=20, srv78088430=90, srv1911367942=48, srv863559754=93, srv931980804=96, srv655203070=82, srv1316284004=19, srv1697414305=38, srv1891038351=45, srv1682749505=37, srv1825502222=42, srv1290407093=18, srv673860922=85, srv2128242560=62, srv864299521=94, srv2090525733=59, srv1985796979=54, srv2039889804=56, srv485663655=78, srv1521823679=32, srv938322452=97, srv1119291885=5, srv24950125=68, srv655262046=83, srv1091450040=2, srv543826990=80, srv2015358469=55, srv877990007=95, srv672057482=84, srv760428101=89, srv2134061923=63, srv1325141305=22, srv1384291071=26, srv1279945499=14, srv1895502545=47, srv1330727546=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:51,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:51,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:51,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:51,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 06:55:51,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 06:55:51,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 06:55:51,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 06:55:51,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 06:55:51,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 06:55:51,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 06:55:51,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 06:55:51,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 06:55:51,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 06:55:51,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=4.265323781513134E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=9.475587393582687E-4); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:51,725 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1287205564:83 , srv1287709632:83 , srv1290116651:83 , srv1449848231:83 , srv1822080257:83 , srv2049873547:83 , srv241856861:83 , srv598733865:83 , srv863559754:83 , srv1052218515:84 , srv1086076688:84 , srv1091450040:84 , srv1092645485:84 , srv1104887274:84 , srv1119291885:84 , srv1166149677:84 , srv1187144335:84 , srv1238673160:84 , srv1247592332:84 , srv1258191175:84 , srv1266980170:84 , srv127946077:84 , srv1279945499:84 , srv1316284004:84 , srv1324788525:84 , srv1325046171:84 , srv1325141305:84 , srv1330727546:84 , srv1364930815:84 , srv1365198058:84 , srv1384291071:84 , srv1406614963:84 , srv1446147626:84 , srv1487510455:84 , srv150580344:84 , srv1521823679:84 , srv1522635267:84 , srv1541407839:84 , srv1555451869:84 , srv1638716054:84 , srv1682749505:84 , srv1697414305:84 , srv1716074008:84 , srv1716724687:84 , srv1831681666:84 , srv1856001850:84 , srv1891038351:84 , srv1892198918:84 , srv1911367942:84 , srv1945545398:84 , srv1967040574:84 , srv19768057:84 , srv1985796979:84 , srv2015358469:84 , srv2039889804:84 , srv2053034767:84 , srv2090525733:84 , srv2114117724:84 , srv2128242560:84 , srv2134061923:84 , srv226822357:84 , srv23364482:84 , srv237652:84 , srv24950125:84 , srv307148287:84 , srv355224440:84 , srv383554850:84 , srv388009322:84 , srv454591214:84 , srv463192354:84 , srv484012113:84 , srv485663655:84 , srv543826990:84 , srv655203070:84 , srv655262046:84 , srv672057482:84 , srv673860922:84 , srv692090419:84 , srv709968368:84 , srv753633250:84 , srv760428101:84 , srv78088430:84 , srv78848275:84 , srv803689441:84 , srv864299521:84 , srv877990007:84 , srv931980804:84 , srv938322452:84 , srv943983348:84 , srv969866293:84 , srv1250742313:85 , srv1290407093:85 , srv1895502545:85 , srv1926683551:85 , srv195489667:85 , srv2100155876:85 , srv323790842:85 , srv440334870:85 , srv4945022:85 , srv1825502222:684 }
2023-04-25 06:55:51,759 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=419 (was 395) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=4528 (was 5015)
2023-04-25 06:55:51,772 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=419, ProcessCount=172, AvailableMemoryMB=4527
2023-04-25 06:55:51,773 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 06:55:51,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-25 06:55:51,785 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041344700:84 , srv1142066855:84 , srv1216075547:84 , srv1331251347:84 , srv1388768591:84 , srv1530122035:84 , srv1637873323:84 , srv1702766587:84 , srv1718341199:84 , srv1752685013:84 , srv1771702183:84 , srv182153999:84 , srv1827563106:84 , srv1867767598:84 , srv1932349453:84 , srv1964165455:84 , srv1968039786:84 , srv2135604305:84 , srv259276744:84 , srv43620074:84 , srv459694669:84 , srv520803280:84 , srv558029108:84 , srv644729120:84 , srv739548575:84 , srv767644467:84 , srv866541818:84 , srv927842990:84 , srv999049357:84 , srv1596035252:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-25 06:55:51,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:55:51,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv999049357=29, srv1637873323=7, srv1142066855=1, srv558029108=23, srv1331251347=3, srv182153999=12, srv1388768591=4, srv1968039786=17, srv43620074=20, srv1530122035=5, srv1964165455=16, srv459694669=21, srv866541818=27, srv767644467=26, srv1771702183=11, srv1041344700=0, srv1216075547=2, srv1932349453=15, srv1596035252=6, srv2135604305=18, srv1718341199=9, srv520803280=22, srv927842990=28, srv1752685013=10, srv1827563106=13, srv259276744=19, srv644729120=24, srv1867767598=14, srv739548575=25, srv1702766587=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:55:51,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:55:51,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:55:51,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:55:51,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:55:51,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:55:51,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:55:51,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:55:51,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 06:55:51,830 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1462404782842242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:55:51,830 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912653842236162, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1462404782842242, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-25 06:57:51,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5926386 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912653842236162 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:57:51,816 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041344700:90 , srv1142066855:90 , srv1216075547:90 , srv1331251347:90 , srv1388768591:90 , srv1530122035:90 , srv1596035252:90 , srv1637873323:90 , srv1702766587:90 , srv1718341199:90 , srv1752685013:90 , srv1771702183:90 , srv182153999:90 , srv1827563106:90 , srv1867767598:90 , srv1932349453:90 , srv1964165455:90 , srv1968039786:90 , srv2135604305:90 , srv259276744:90 , srv43620074:90 , srv459694669:90 , srv520803280:90 , srv558029108:90 , srv644729120:90 , srv739548575:90 , srv767644467:90 , srv866541818:90 , srv927842990:90 , srv999049357:90 }
2023-04-25 06:57:51,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 06:57:51,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv999049357=29, srv1637873323=7, srv1142066855=1, srv558029108=23, srv1331251347=3, srv182153999=12, srv1388768591=4, srv1968039786=17, srv43620074=20, srv1530122035=5, srv1964165455=16, srv459694669=21, srv866541818=27, srv767644467=26, srv1771702183=11, srv1041344700=0, srv1216075547=2, srv1932349453=15, srv1596035252=6, srv2135604305=18, srv1718341199=9, srv520803280=22, srv927842990=28, srv1752685013=10, srv1827563106=13, srv259276744=19, srv644729120=24, srv1867767598=14, srv739548575=25, srv1702766587=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 06:57:51,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 06:57:51,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 06:57:51,834 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 06:57:51,834 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1041344700:90 , srv1142066855:90 , srv1216075547:90 , srv1331251347:90 , srv1388768591:90 , srv1530122035:90 , srv1596035252:90 , srv1637873323:90 , srv1702766587:90 , srv1718341199:90 , srv1752685013:90 , srv1771702183:90 , srv182153999:90 , srv1827563106:90 , srv1867767598:90 , srv1932349453:90 , srv1964165455:90 , srv1968039786:90 , srv2135604305:90 , srv259276744:90 , srv43620074:90 , srv459694669:90 , srv520803280:90 , srv558029108:90 , srv644729120:90 , srv739548575:90 , srv767644467:90 , srv866541818:90 , srv927842990:90 , srv999049357:90 }
2023-04-25 06:57:51,847 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 419), ProcessCount=172 (was 172), AvailableMemoryMB=4400 (was 4527)