2023-12-09 15:53:13,346 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-09 15:53:13,664 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-09 15:53:13,780 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-09 15:53:13,841 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-09 15:53:13,848 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-09 15:53:13,861 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=170, AvailableMemoryMB=7281
2023-12-09 15:53:13,863 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-09 15:53:13,864 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-09 15:53:14,000 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1006165734:84 , srv1033350162:84 , srv1044524169:84 , srv1062047244:84 , srv106466082:84 , srv1089372689:84 , srv1096129426:84 , srv113325495:84 , srv1168360903:84 , srv1181654043:84 , srv1186992884:84 , srv1190151737:84 , srv1207267261:84 , srv1217896726:84 , srv1276524689:84 , srv1303754457:84 , srv1303788460:84 , srv1316061221:84 , srv1341916478:84 , srv1346401762:84 , srv1377952818:84 , srv1406038159:84 , srv1413713609:84 , srv142218455:84 , srv1438525892:84 , srv1440018589:84 , srv144183160:84 , srv1522213130:84 , srv1544852025:84 , srv156911059:84 , srv1584483678:84 , srv160645756:84 , srv1618060592:84 , srv1620195951:84 , srv1621840935:84 , srv1623298812:84 , srv1625859207:84 , srv1637903439:84 , srv1709836968:84 , srv1748007256:84 , srv1749969258:84 , srv1752964125:84 , srv1825183224:84 , srv1827473597:84 , srv1829021571:84 , srv1855480231:84 , srv18659511:84 , srv187312360:84 , srv1920027568:84 , srv1927614341:84 , srv1993938448:84 , srv2001425613:84 , srv2007747467:84 , srv2048123045:84 , srv205799235:84 , srv2064707472:84 , srv2094270700:84 , srv2104732676:84 , srv2134029869:84 , srv2134667844:84 , srv294129195:84 , srv296005689:84 , srv301640334:84 , srv306340251:84 , srv381472072:84 , srv441067980:84 , srv450560113:84 , srv4605946:84 , srv495540163:84 , srv50044343:84 , srv503180526:84 , srv505500970:84 , srv508811959:84 , srv540817126:84 , srv567063319:84 , srv577223387:84 , srv603796377:84 , srv612395659:84 , srv618087090:84 , srv622625955:84 , srv623131263:84 , srv638905858:84 , srv652244674:84 , srv654779872:84 , srv660087992:84 , srv660580112:84 , srv666720113:84 , srv686019484:84 , srv695014413:84 , srv709098932:84 , srv709581318:84 , srv73131606:84 , srv782934006:84 , srv802201108:84 , srv805624267:84 , srv823149705:84 , srv935488539:84 , srv982416396:84 , srv98796101:84 , srv1673965184:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-09 15:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:14,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:14,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:14,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:14,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:14,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:14,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:14,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:14,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:14,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:14,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:14,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:14,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:14,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:14,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:14,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:14,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:14,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:14,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:14,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:14,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:14,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:14,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:14,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:14,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:14,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:14,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:14,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:14,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:14,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:14,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:14,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:14,379 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:14,379 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-09 15:53:14,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-09 15:53:14,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 711 ms to try 5000 different iterations.  Found a solution that moves 4663 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17983030553887672. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0418469351422014, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059658587192571805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5181111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0418469351422014, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:14,889 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv106466082:81 , srv2064707472:81 , srv660580112:81 , srv1438525892:82 , srv1748007256:82 , srv1825183224:82 , srv686019484:82 , srv1618060592:83 , srv187312360:83 , srv505500970:83 , srv612395659:83 , srv73131606:83 , srv1062047244:84 , srv1316061221:84 , srv1341916478:84 , srv2048123045:84 , srv205799235:84 , srv2104732676:84 , srv294129195:84 , srv381472072:84 , srv450560113:84 , srv4605946:84 , srv660087992:84 , srv666720113:84 , srv805624267:84 , srv1033350162:85 , srv1440018589:85 , srv1544852025:85 , srv156911059:85 , srv1625859207:85 , srv1637903439:85 , srv1855480231:85 , srv1920027568:85 , srv1993938448:85 , srv2134667844:85 , srv50044343:85 , srv603796377:85 , srv709581318:85 , srv782934006:85 , srv98796101:85 , srv113325495:86 , srv1168360903:86 , srv1181654043:86 , srv1413713609:86 , srv1620195951:86 , srv1752964125:86 , srv18659511:86 , srv2001425613:86 , srv2134029869:86 , srv577223387:86 , srv652244674:86 , srv695014413:86 , srv709098932:86 , srv1044524169:87 , srv1096129426:87 , srv1186992884:87 , srv1207267261:87 , srv1217896726:87 , srv1303788460:87 , srv1377952818:87 , srv1406038159:87 , srv142218455:87 , srv144183160:87 , srv1621840935:87 , srv1709836968:87 , srv1827473597:87 , srv1829021571:87 , srv441067980:87 , srv503180526:87 , srv567063319:87 , srv618087090:87 , srv622625955:87 , srv982416396:87 , srv1522213130:88 , srv160645756:88 , srv2007747467:88 , srv2094270700:88 , srv306340251:88 , srv495540163:88 , srv623131263:88 , srv654779872:88 , srv1346401762:89 , srv1584483678:89 , srv1623298812:89 , srv296005689:89 , srv301640334:89 , srv508811959:89 , srv638905858:89 , srv802201108:89 , srv935488539:89 , srv1276524689:90 , srv823149705:90 , srv1006165734:91 , srv1190151737:91 , srv1303754457:91 , srv1927614341:91 , srv540817126:92 , srv1089372689:93 , srv1749969258:93 , srv1673965184:462 }
2023-12-09 15:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:14,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:14,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:14,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:14,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:14,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:14,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:14,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:14,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:14,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:14,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:15,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0418469351422014, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059658587192571805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0418469351422014, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:15,032 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-09 15:53:15,032 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1797976545150124, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0418469351422014, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059658587192571805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0418469351422014, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24191666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-09 15:53:15,373 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 444 ms to try 5000 different iterations.  Found a solution that moves 2632 regions; Going from a computed imbalance of 0.1797976545150124 to a new imbalance of 0.016933807285955144. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02452339052574428); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0349121070526432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29244444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02452339052574428); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:15,387 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1749969258:77 , srv540817126:80 , srv1089372689:81 , srv1303754457:81 , srv301640334:81 , srv508811959:81 , srv638905858:81 , srv1006165734:82 , srv1190151737:82 , srv1276524689:82 , srv1623298812:82 , srv1927614341:82 , srv2007747467:82 , srv654779872:82 , srv802201108:82 , srv1096129426:83 , srv144183160:83 , srv1522213130:83 , srv296005689:83 , srv306340251:83 , srv823149705:83 , srv1044524169:84 , srv1207267261:84 , srv1377952818:84 , srv1584483678:84 , srv1620195951:84 , srv1621840935:84 , srv1709836968:84 , srv1829021571:84 , srv2134029869:84 , srv503180526:84 , srv567063319:84 , srv577223387:84 , srv618087090:84 , srv623131263:84 , srv709098932:84 , srv935488539:84 , srv1303788460:85 , srv1413713609:85 , srv1827473597:85 , srv1855480231:85 , srv18659511:85 , srv495540163:85 , srv622625955:85 , srv1033350162:86 , srv113325495:86 , srv1341916478:86 , srv142218455:86 , srv160645756:86 , srv1637903439:86 , srv1920027568:86 , srv1993938448:86 , srv2001425613:86 , srv294129195:86 , srv4605946:86 , srv660087992:86 , srv805624267:86 , srv1062047244:87 , srv1181654043:87 , srv1186992884:87 , srv1217896726:87 , srv1316061221:87 , srv1406038159:87 , srv1440018589:87 , srv1752964125:87 , srv2048123045:87 , srv2134667844:87 , srv441067980:87 , srv50044343:87 , srv505500970:87 , srv603796377:87 , srv612395659:87 , srv652244674:87 , srv782934006:87 , srv982416396:87 , srv98796101:87 , srv1168360903:88 , srv1346401762:88 , srv156911059:88 , srv1618060592:88 , srv1625859207:88 , srv1825183224:88 , srv205799235:88 , srv2094270700:88 , srv2104732676:88 , srv381472072:88 , srv666720113:88 , srv686019484:88 , srv695014413:88 , srv709581318:88 , srv73131606:88 , srv1544852025:89 , srv1748007256:89 , srv450560113:89 , srv1438525892:90 , srv2064707472:91 , srv660580112:91 , srv106466082:92 , srv187312360:93 , srv1673965184:530 }
2023-12-09 15:53:15,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:15,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:15,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:15,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:15,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:15,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:15,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:15,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:15,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:15,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:15,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:15,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:15,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:15,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:15,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02452339052574428); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0349121070526432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02452339052574428); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:15,585 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-09 15:53:15,585 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016915377628050166, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02452339052574428); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0349121070526432, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02452339052574428); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04816666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-09 15:53:15,850 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 398 ms to try 5000 different iterations.  Found a solution that moves 1050 regions; Going from a computed imbalance of 0.016915377628050166 to a new imbalance of 9.20729702930893E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627587); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007075034750641397); MoveCostFunction : (multiplier=7.0, imbalance=0.11666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007011294399627587); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:15,852 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1346401762:80 , srv187312360:81 , srv1544852025:82 , srv2094270700:82 , srv1006165734:83 , srv1089372689:83 , srv1217896726:83 , srv1625859207:83 , srv441067980:83 , srv695014413:83 , srv106466082:84 , srv1168360903:84 , srv1186992884:84 , srv1276524689:84 , srv1406038159:84 , srv1584483678:84 , srv160645756:84 , srv1752964125:84 , srv50044343:84 , srv540817126:84 , srv652244674:84 , srv660580112:84 , srv823149705:84 , srv935488539:84 , srv113325495:85 , srv1181654043:85 , srv1190151737:85 , srv1303754457:85 , srv1377952818:85 , srv1413713609:85 , srv142218455:85 , srv156911059:85 , srv1827473597:85 , srv1927614341:85 , srv1993938448:85 , srv205799235:85 , srv2064707472:85 , srv2104732676:85 , srv2134667844:85 , srv296005689:85 , srv306340251:85 , srv381472072:85 , srv495540163:85 , srv982416396:85 , srv98796101:85 , srv1033350162:86 , srv1207267261:86 , srv1303788460:86 , srv1316061221:86 , srv1341916478:86 , srv1438525892:86 , srv1440018589:86 , srv1618060592:86 , srv1621840935:86 , srv1709836968:86 , srv1748007256:86 , srv18659511:86 , srv1920027568:86 , srv2001425613:86 , srv450560113:86 , srv622625955:86 , srv623131263:86 , srv666720113:86 , srv709581318:86 , srv73131606:86 , srv782934006:86 , srv1044524169:87 , srv1062047244:87 , srv1096129426:87 , srv144183160:87 , srv1522213130:87 , srv1620195951:87 , srv1623298812:87 , srv1637903439:87 , srv1825183224:87 , srv1829021571:87 , srv1855480231:87 , srv294129195:87 , srv4605946:87 , srv503180526:87 , srv567063319:87 , srv577223387:87 , srv603796377:87 , srv618087090:87 , srv638905858:87 , srv686019484:87 , srv709098932:87 , srv805624267:87 , srv1749969258:88 , srv2007747467:88 , srv2048123045:88 , srv2134029869:88 , srv301640334:88 , srv505500970:88 , srv508811959:88 , srv612395659:88 , srv654779872:88 , srv660087992:88 , srv802201108:88 , srv1673965184:528 }
2023-12-09 15:53:15,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:15,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:15,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:15,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:15,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:15,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:15,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:16,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627587); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007075034750641397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007011294399627587); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:16,008 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-09 15:53:16,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.1337744578795E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007011294399627587); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007075034750641397); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007011294399627587); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-09 15:53:16,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 253 regions; Going from a computed imbalance of 9.1337744578795E-4 to a new imbalance of 2.7588746064271174E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.02811111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:16,439 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1927614341:83 , srv2001425613:83 , srv2048123045:83 , srv603796377:83 , srv709581318:83 , srv802201108:83 , srv982416396:83 , srv1044524169:84 , srv1062047244:84 , srv1168360903:84 , srv1181654043:84 , srv1186992884:84 , srv1190151737:84 , srv1303788460:84 , srv1406038159:84 , srv142218455:84 , srv1438525892:84 , srv1440018589:84 , srv1522213130:84 , srv156911059:84 , srv1584483678:84 , srv160645756:84 , srv1621840935:84 , srv1623298812:84 , srv1637903439:84 , srv1749969258:84 , srv1752964125:84 , srv1829021571:84 , srv2007747467:84 , srv2094270700:84 , srv2104732676:84 , srv2134029869:84 , srv301640334:84 , srv450560113:84 , srv495540163:84 , srv503180526:84 , srv505500970:84 , srv508811959:84 , srv567063319:84 , srv612395659:84 , srv618087090:84 , srv623131263:84 , srv654779872:84 , srv660087992:84 , srv666720113:84 , srv709098932:84 , srv782934006:84 , srv1033350162:85 , srv106466082:85 , srv1089372689:85 , srv1096129426:85 , srv113325495:85 , srv1207267261:85 , srv1217896726:85 , srv1276524689:85 , srv1303754457:85 , srv1316061221:85 , srv1413713609:85 , srv144183160:85 , srv1618060592:85 , srv1620195951:85 , srv1709836968:85 , srv1825183224:85 , srv1827473597:85 , srv1855480231:85 , srv18659511:85 , srv187312360:85 , srv1920027568:85 , srv205799235:85 , srv2064707472:85 , srv294129195:85 , srv296005689:85 , srv381472072:85 , srv441067980:85 , srv622625955:85 , srv638905858:85 , srv652244674:85 , srv686019484:85 , srv73131606:85 , srv805624267:85 , srv935488539:85 , srv98796101:85 , srv1006165734:86 , srv1341916478:86 , srv1346401762:86 , srv1377952818:86 , srv1544852025:86 , srv1625859207:86 , srv1748007256:86 , srv1993938448:86 , srv2134667844:86 , srv306340251:86 , srv4605946:86 , srv50044343:86 , srv540817126:86 , srv577223387:86 , srv660580112:86 , srv695014413:86 , srv823149705:86 , srv1673965184:622 }
2023-12-09 15:53:16,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:16,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:16,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:16,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:16,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:16,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:16,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:16,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:16,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:16,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:16,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:16,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:16,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:16,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:16,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:16,582 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:16,583 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-09 15:53:16,583 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.581720220030494E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-09 15:53:16,891 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 414 ms to try 5000 different iterations.  Found a solution that moves 25 regions; Going from a computed imbalance of 2.581720220030494E-5 to a new imbalance of 6.919122795330589E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.002777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:16,892 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1346401762:83 , srv1748007256:83 , srv2134667844:83 , srv450560113:83 , srv4605946:83 , srv577223387:83 , srv622625955:83 , srv695014413:83 , srv823149705:83 , srv1006165734:84 , srv1033350162:84 , srv1044524169:84 , srv1062047244:84 , srv106466082:84 , srv1089372689:84 , srv1096129426:84 , srv113325495:84 , srv1168360903:84 , srv1181654043:84 , srv1186992884:84 , srv1190151737:84 , srv1207267261:84 , srv1217896726:84 , srv1303754457:84 , srv1303788460:84 , srv1316061221:84 , srv1341916478:84 , srv1377952818:84 , srv1406038159:84 , srv142218455:84 , srv1438525892:84 , srv1440018589:84 , srv144183160:84 , srv1522213130:84 , srv1544852025:84 , srv156911059:84 , srv160645756:84 , srv1618060592:84 , srv1620195951:84 , srv1623298812:84 , srv1625859207:84 , srv1637903439:84 , srv1709836968:84 , srv1749969258:84 , srv1825183224:84 , srv1827473597:84 , srv1829021571:84 , srv1855480231:84 , srv18659511:84 , srv187312360:84 , srv1920027568:84 , srv1993938448:84 , srv2007747467:84 , srv2048123045:84 , srv205799235:84 , srv2064707472:84 , srv2094270700:84 , srv2134029869:84 , srv294129195:84 , srv296005689:84 , srv301640334:84 , srv306340251:84 , srv381472072:84 , srv441067980:84 , srv495540163:84 , srv50044343:84 , srv503180526:84 , srv505500970:84 , srv508811959:84 , srv540817126:84 , srv567063319:84 , srv603796377:84 , srv612395659:84 , srv618087090:84 , srv623131263:84 , srv638905858:84 , srv652244674:84 , srv654779872:84 , srv660087992:84 , srv660580112:84 , srv666720113:84 , srv686019484:84 , srv709581318:84 , srv73131606:84 , srv782934006:84 , srv802201108:84 , srv805624267:84 , srv935488539:84 , srv982416396:84 , srv98796101:84 , srv1276524689:85 , srv1413713609:85 , srv1584483678:85 , srv1621840935:85 , srv1752964125:85 , srv1927614341:85 , srv2001425613:85 , srv2104732676:85 , srv709098932:85 , srv1673965184:684 }
2023-12-09 15:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1303788460=16, srv1829021571=45, srv686019484=88, srv2134029869=59, srv823149705=96, srv441067980=66, srv503180526=71, srv1673965184=38, srv1303754457=15, srv1276524689=14, srv709581318=91, srv142218455=23, srv2048123045=54, srv98796101=99, srv1062047244=3, srv623131263=81, srv1190151737=11, srv1406038159=21, srv1825183224=43, srv577223387=76, srv695014413=89, srv567063319=75, srv1168360903=8, srv50044343=70, srv144183160=26, srv603796377=77, srv301640334=63, srv1522213130=27, srv495540163=69, srv306340251=64, srv1749969258=41, srv1993938448=51, srv982416396=98, srv1316061221=17, srv1827473597=44, srv2134667844=60, srv1927614341=50, srv1752964125=42, srv540817126=74, srv1620195951=33, srv73131606=92, srv1618060592=32, srv660580112=86, srv1186992884=10, srv660087992=85, srv1217896726=13, srv1413713609=22, srv1377952818=20, srv1748007256=40, srv106466082=4, srv1096129426=6, srv935488539=97, srv160645756=31, srv1623298812=35, srv1033350162=1, srv505500970=72, srv782934006=93, srv1625859207=36, srv1920027568=49, srv612395659=78, srv205799235=55, srv666720113=87, srv1089372689=5, srv1006165734=0, srv2094270700=57, srv805624267=95, srv1341916478=18, srv802201108=94, srv381472072=65, srv622625955=80, srv1438525892=24, srv156911059=29, srv618087090=79, srv18659511=47, srv709098932=90, srv638905858=82, srv1181654043=9, srv187312360=48, srv450560113=67, srv4605946=68, srv1584483678=30, srv654779872=84, srv652244674=83, srv2001425613=52, srv1207267261=12, srv1440018589=25, srv1044524169=2, srv113325495=7, srv2104732676=58, srv1621840935=34, srv296005689=62, srv1637903439=37, srv1346401762=19, srv2064707472=56, srv1709836968=39, srv508811959=73, srv1544852025=28, srv294129195=61, srv2007747467=53, srv1855480231=46} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:16,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:16,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:16,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:16,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:16,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-09 15:53:16,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-09 15:53:16,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-09 15:53:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-09 15:53:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-09 15:53:16,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-09 15:53:16,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-09 15:53:16,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-09 15:53:16,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-09 15:53:16,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-09 15:53:17,034 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:17,034 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1346401762:83 , srv1748007256:83 , srv2134667844:83 , srv450560113:83 , srv4605946:83 , srv577223387:83 , srv622625955:83 , srv695014413:83 , srv823149705:83 , srv1006165734:84 , srv1033350162:84 , srv1044524169:84 , srv1062047244:84 , srv106466082:84 , srv1089372689:84 , srv1096129426:84 , srv113325495:84 , srv1168360903:84 , srv1181654043:84 , srv1186992884:84 , srv1190151737:84 , srv1207267261:84 , srv1217896726:84 , srv1303754457:84 , srv1303788460:84 , srv1316061221:84 , srv1341916478:84 , srv1377952818:84 , srv1406038159:84 , srv142218455:84 , srv1438525892:84 , srv1440018589:84 , srv144183160:84 , srv1522213130:84 , srv1544852025:84 , srv156911059:84 , srv160645756:84 , srv1618060592:84 , srv1620195951:84 , srv1623298812:84 , srv1625859207:84 , srv1637903439:84 , srv1709836968:84 , srv1749969258:84 , srv1825183224:84 , srv1827473597:84 , srv1829021571:84 , srv1855480231:84 , srv18659511:84 , srv187312360:84 , srv1920027568:84 , srv1993938448:84 , srv2007747467:84 , srv2048123045:84 , srv205799235:84 , srv2064707472:84 , srv2094270700:84 , srv2134029869:84 , srv294129195:84 , srv296005689:84 , srv301640334:84 , srv306340251:84 , srv381472072:84 , srv441067980:84 , srv495540163:84 , srv50044343:84 , srv503180526:84 , srv505500970:84 , srv508811959:84 , srv540817126:84 , srv567063319:84 , srv603796377:84 , srv612395659:84 , srv618087090:84 , srv623131263:84 , srv638905858:84 , srv652244674:84 , srv654779872:84 , srv660087992:84 , srv660580112:84 , srv666720113:84 , srv686019484:84 , srv709581318:84 , srv73131606:84 , srv782934006:84 , srv802201108:84 , srv805624267:84 , srv935488539:84 , srv982416396:84 , srv98796101:84 , srv1276524689:85 , srv1413713609:85 , srv1584483678:85 , srv1621840935:85 , srv1752964125:85 , srv1927614341:85 , srv2001425613:85 , srv2104732676:85 , srv709098932:85 , srv1673965184:684 }
2023-12-09 15:53:17,062 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 307), ProcessCount=170 (was 170), AvailableMemoryMB=6383 (was 7281)
2023-12-09 15:53:17,070 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=170, AvailableMemoryMB=6382
2023-12-09 15:53:17,071 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-09 15:53:17,071 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-09 15:53:17,095 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013642458:84 , srv1019934751:84 , srv1092459344:84 , srv1148566740:84 , srv1203743210:84 , srv1370745019:84 , srv1401953347:84 , srv1506543523:84 , srv1688394368:84 , srv1730583395:84 , srv1760677041:84 , srv1775691864:84 , srv1873333330:84 , srv1900910414:84 , srv192600648:84 , srv215813438:84 , srv347306810:84 , srv405682314:84 , srv480467244:84 , srv515801870:84 , srv581126664:84 , srv662674124:84 , srv678993264:84 , srv688881589:84 , srv702188034:84 , srv723454254:84 , srv773226138:84 , srv793734165:84 , srv809693167:84 , srv240818593:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-09 15:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:53:17,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1900910414=13, srv773226138=27, srv1688394368=8, srv1873333330=12, srv515801870=20, srv581126664=21, srv215813438=15, srv347306810=17, srv1203743210=4, srv240818593=16, srv688881589=24, srv1013642458=0, srv702188034=25, srv1730583395=9, srv405682314=18, srv480467244=19, srv678993264=23, srv1148566740=3, srv809693167=29, srv192600648=14, srv793734165=28, srv1506543523=7, srv1092459344=2, srv1775691864=11, srv662674124=22, srv723454254=26, srv1019934751=1, srv1760677041=10, srv1370745019=5, srv1401953347=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:53:17,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:53:17,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:53:17,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:53:17,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:53:17,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:53:17,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-09 15:53:17,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.104173906705269, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:53:17,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912521291842717, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.104173906705269, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-09 15:55:17,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5895800 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912521291842717 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:55:17,124 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013642458:90 , srv1019934751:90 , srv1092459344:90 , srv1148566740:90 , srv1203743210:90 , srv1370745019:90 , srv1401953347:90 , srv1506543523:90 , srv1688394368:90 , srv1730583395:90 , srv1760677041:90 , srv1775691864:90 , srv1873333330:90 , srv1900910414:90 , srv192600648:90 , srv215813438:90 , srv240818593:90 , srv347306810:90 , srv405682314:90 , srv480467244:90 , srv515801870:90 , srv581126664:90 , srv662674124:90 , srv678993264:90 , srv688881589:90 , srv702188034:90 , srv723454254:90 , srv773226138:90 , srv793734165:90 , srv809693167:90 }
2023-12-09 15:55:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-09 15:55:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1900910414=13, srv773226138=27, srv1688394368=8, srv1873333330=12, srv515801870=20, srv581126664=21, srv215813438=15, srv347306810=17, srv1203743210=4, srv240818593=16, srv688881589=24, srv1013642458=0, srv702188034=25, srv1730583395=9, srv405682314=18, srv480467244=19, srv678993264=23, srv1148566740=3, srv809693167=29, srv192600648=14, srv793734165=28, srv1506543523=7, srv1092459344=2, srv1775691864=11, srv662674124=22, srv723454254=26, srv1019934751=1, srv1760677041=10, srv1370745019=5, srv1401953347=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-09 15:55:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-09 15:55:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-09 15:55:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-09 15:55:17,149 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-09 15:55:17,149 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013642458:90 , srv1019934751:90 , srv1092459344:90 , srv1148566740:90 , srv1203743210:90 , srv1370745019:90 , srv1401953347:90 , srv1506543523:90 , srv1688394368:90 , srv1730583395:90 , srv1760677041:90 , srv1775691864:90 , srv1873333330:90 , srv1900910414:90 , srv192600648:90 , srv215813438:90 , srv240818593:90 , srv347306810:90 , srv405682314:90 , srv480467244:90 , srv515801870:90 , srv581126664:90 , srv662674124:90 , srv678993264:90 , srv688881589:90 , srv702188034:90 , srv723454254:90 , srv773226138:90 , srv793734165:90 , srv809693167:90 }
2023-12-09 15:55:17,161 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 307), ProcessCount=168 (was 170), AvailableMemoryMB=5757 (was 6382)