2023-09-22 22:53:13,689 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-22 22:53:14,040 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-22 22:53:14,156 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-22 22:53:14,213 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-22 22:53:14,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-22 22:53:14,234 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=171, AvailableMemoryMB=3074
2023-09-22 22:53:14,236 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-22 22:53:14,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-22 22:53:14,379 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003775156:84 , srv1008468205:84 , srv1020434512:84 , srv1034521105:84 , srv1069410438:84 , srv1091071120:84 , srv1108142196:84 , srv1122527352:84 , srv1167127222:84 , srv1245285981:84 , srv1253623317:84 , srv1280364230:84 , srv1304671436:84 , srv1312957374:84 , srv1316493914:84 , srv1316911188:84 , srv1343662445:84 , srv136627228:84 , srv1381608244:84 , srv1383241529:84 , srv1408359084:84 , srv1413069845:84 , srv1444823510:84 , srv1445477399:84 , srv1462046178:84 , srv1473996440:84 , srv1481345753:84 , srv148154258:84 , srv1506503364:84 , srv1508933377:84 , srv1519393278:84 , srv1522670776:84 , srv1532366187:84 , srv1562456375:84 , srv1563668485:84 , srv1567514117:84 , srv1601473981:84 , srv1615439158:84 , srv1643065808:84 , srv1693433085:84 , srv1720596550:84 , srv1760195511:84 , srv1773059410:84 , srv1832342599:84 , srv1853567598:84 , srv1858800418:84 , srv1939231752:84 , srv2013599534:84 , srv2027539328:84 , srv2046405351:84 , srv205447436:84 , srv2111292130:84 , srv2124222496:84 , srv2144462495:84 , srv217919002:84 , srv244287568:84 , srv247730604:84 , srv250503832:84 , srv256360268:84 , srv267721833:84 , srv287947693:84 , srv300119709:84 , srv312628281:84 , srv316613103:84 , srv347252388:84 , srv365790985:84 , srv370889720:84 , srv37135096:84 , srv376520052:84 , srv474825637:84 , srv492524505:84 , srv497914077:84 , srv523873102:84 , srv528067601:84 , srv547038002:84 , srv59793291:84 , srv6107511:84 , srv617104199:84 , srv637729573:84 , srv656144347:84 , srv666539297:84 , srv673058776:84 , srv695108607:84 , srv765142901:84 , srv777016359:84 , srv788593199:84 , srv790891941:84 , srv793219357:84 , srv825929446:84 , srv8506824:84 , srv857518246:84 , srv885073649:84 , srv885801927:84 , srv929294923:84 , srv935972798:84 , srv939128917:84 , srv945148770:84 , srv963780140:84 , srv993120224:84 , srv528740779:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-22 22:53:14,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:14,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv256360268=58, srv1473996440=25, srv474825637=69, srv1381608244=18, srv300119709=61, srv2013599534=47, srv993120224=99, srv857518246=91, srv492524505=70, srv1034521105=3, srv247730604=56, srv617104199=78, srv365790985=65, srv777016359=85, srv1563668485=34, srv637729573=79, srv497914077=71, srv2027539328=48, srv765142901=84, srv316613103=63, srv945148770=97, srv666539297=81, srv1108142196=6, srv376520052=68, srv148154258=27, srv1304671436=12, srv1832342599=43, srv1316911188=15, srv695108607=83, srv1245285981=9, srv1858800418=45, srv656144347=80, srv217919002=54, srv1939231752=46, srv1519393278=30, srv790891941=87, srv1462046178=24, srv136627228=17, srv1003775156=0, srv885073649=92, srv1773059410=42, srv885801927=93, srv547038002=75, srv1853567598=44, srv1615439158=37, srv2144462495=53, srv1316493914=14, srv1343662445=16, srv1020434512=2, srv1601473981=36, srv370889720=66, srv287947693=60, srv1445477399=23, srv673058776=82, srv347252388=64, srv1506503364=28, srv1693433085=39, srv205447436=50, srv1481345753=26, srv1444823510=22, srv1567514117=35, srv312628281=62, srv1562456375=33, srv825929446=89, srv963780140=98, srv1167127222=8, srv528740779=74, srv37135096=67, srv1413069845=21, srv1720596550=40, srv1069410438=4, srv2111292130=51, srv1383241529=19, srv267721833=59, srv788593199=86, srv939128917=96, srv250503832=57, srv59793291=76, srv8506824=90, srv523873102=72, srv6107511=77, srv1091071120=5, srv1522670776=31, srv1760195511=41, srv1280364230=11, srv244287568=55, srv1532366187=32, srv935972798=95, srv1312957374=13, srv1508933377=29, srv793219357=88, srv1122527352=7, srv2124222496=52, srv1408359084=20, srv1253623317=10, srv929294923=94, srv1008468205=1, srv528067601=73, srv2046405351=49, srv1643065808=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-22 22:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-22 22:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-22 22:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-22 22:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-22 22:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-22 22:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-22 22:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-22 22:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-22 22:53:14,711 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:14,712 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-22 22:53:14,712 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-22 22:53:15,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 615 ms to try 5000 different iterations.  Found a solution that moves 4695 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17668781255212312. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04064543489713579, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611036103109016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5216666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04064543489713579, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:15,155 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1316911188:82 , srv1381608244:82 , srv1034521105:83 , srv1413069845:83 , srv1462046178:83 , srv1519393278:83 , srv1522670776:83 , srv1615439158:83 , srv1720596550:83 , srv1760195511:83 , srv1853567598:83 , srv1858800418:83 , srv59793291:83 , srv765142901:83 , srv790891941:83 , srv1003775156:84 , srv1069410438:84 , srv1343662445:84 , srv1508933377:84 , srv1643065808:84 , srv205447436:84 , srv2124222496:84 , srv300119709:84 , srv316613103:84 , srv365790985:84 , srv617104199:84 , srv656144347:84 , srv777016359:84 , srv885073649:84 , srv939128917:84 , srv1020434512:85 , srv1091071120:85 , srv1122527352:85 , srv1304671436:85 , srv1444823510:85 , srv1445477399:85 , srv1562456375:85 , srv1563668485:85 , srv2046405351:85 , srv2111292130:85 , srv250503832:85 , srv256360268:85 , srv312628281:85 , srv370889720:85 , srv497914077:85 , srv695108607:85 , srv788593199:85 , srv945148770:85 , srv993120224:85 , srv136627228:86 , srv1383241529:86 , srv1473996440:86 , srv1506503364:86 , srv1832342599:86 , srv1939231752:86 , srv217919002:86 , srv523873102:86 , srv637729573:86 , srv857518246:86 , srv935972798:86 , srv1167127222:87 , srv1316493914:87 , srv1408359084:87 , srv148154258:87 , srv1693433085:87 , srv1773059410:87 , srv2027539328:87 , srv347252388:87 , srv37135096:87 , srv528067601:87 , srv673058776:87 , srv8506824:87 , srv929294923:87 , srv1481345753:88 , srv474825637:88 , srv492524505:88 , srv963780140:88 , srv1108142196:89 , srv2013599534:89 , srv267721833:89 , srv547038002:89 , srv666539297:89 , srv1280364230:90 , srv1601473981:90 , srv6107511:90 , srv1532366187:91 , srv247730604:91 , srv376520052:91 , srv793219357:91 , srv885801927:91 , srv1008468205:92 , srv1245285981:92 , srv1253623317:92 , srv244287568:92 , srv287947693:92 , srv825929446:92 , srv1312957374:93 , srv1567514117:93 , srv2144462495:94 , srv528740779:451 }
2023-09-22 22:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv256360268=58, srv1473996440=25, srv474825637=69, srv1381608244=18, srv300119709=61, srv2013599534=47, srv993120224=99, srv857518246=91, srv492524505=70, srv1034521105=3, srv247730604=56, srv617104199=78, srv365790985=65, srv777016359=85, srv1563668485=34, srv637729573=79, srv497914077=71, srv2027539328=48, srv765142901=84, srv316613103=63, srv945148770=97, srv666539297=81, srv1108142196=6, srv376520052=68, srv148154258=27, srv1304671436=12, srv1832342599=43, srv1316911188=15, srv695108607=83, srv1245285981=9, srv1858800418=45, srv656144347=80, srv217919002=54, srv1939231752=46, srv1519393278=30, srv790891941=87, srv1462046178=24, srv136627228=17, srv1003775156=0, srv885073649=92, srv1773059410=42, srv885801927=93, srv547038002=75, srv1853567598=44, srv1615439158=37, srv2144462495=53, srv1316493914=14, srv1343662445=16, srv1020434512=2, srv1601473981=36, srv370889720=66, srv287947693=60, srv1445477399=23, srv673058776=82, srv347252388=64, srv1506503364=28, srv1693433085=39, srv205447436=50, srv1481345753=26, srv1444823510=22, srv1567514117=35, srv312628281=62, srv1562456375=33, srv825929446=89, srv963780140=98, srv1167127222=8, srv528740779=74, srv37135096=67, srv1413069845=21, srv1720596550=40, srv1069410438=4, srv2111292130=51, srv1383241529=19, srv267721833=59, srv788593199=86, srv939128917=96, srv250503832=57, srv59793291=76, srv8506824=90, srv523873102=72, srv6107511=77, srv1091071120=5, srv1522670776=31, srv1760195511=41, srv1280364230=11, srv244287568=55, srv1532366187=32, srv935972798=95, srv1312957374=13, srv1508933377=29, srv793219357=88, srv1122527352=7, srv2124222496=52, srv1408359084=20, srv1253623317=10, srv929294923=94, srv1008468205=1, srv528067601=73, srv2046405351=49, srv1643065808=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:15,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:15,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-22 22:53:15,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-22 22:53:15,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-22 22:53:15,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-22 22:53:15,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-22 22:53:15,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-22 22:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-22 22:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-22 22:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-22 22:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-22 22:53:15,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-22 22:53:15,461 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04064543489713579, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611036103109016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04064543489713579, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:15,461 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-22 22:53:15,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17665493745946967, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04064543489713579, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05611036103109016, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04064543489713579, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24058333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-22 22:53:15,917 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 700 ms to try 5000 different iterations.  Found a solution that moves 2652 regions; Going from a computed imbalance of 0.17665493745946967 to a new imbalance of 0.015312757638081102. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0221626586701954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028950982219826407, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2946666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0221626586701954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:15,931 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1008468205:77 , srv1567514117:77 , srv1312957374:78 , srv244287568:78 , srv2144462495:79 , srv1253623317:80 , srv376520052:80 , srv885801927:80 , srv1245285981:81 , srv825929446:81 , srv1108142196:82 , srv1280364230:82 , srv1601473981:82 , srv2013599534:82 , srv247730604:82 , srv6107511:82 , srv666539297:82 , srv793219357:82 , srv1532366187:83 , srv1773059410:83 , srv287947693:83 , srv1167127222:84 , srv148154258:84 , srv1506503364:84 , srv1832342599:84 , srv1939231752:84 , srv528067601:84 , srv8506824:84 , srv929294923:84 , srv963780140:84 , srv1473996440:85 , srv256360268:85 , srv492524505:85 , srv523873102:85 , srv547038002:85 , srv857518246:85 , srv1069410438:86 , srv1091071120:86 , srv1316493914:86 , srv1383241529:86 , srv1408359084:86 , srv1444823510:86 , srv1481345753:86 , srv1563668485:86 , srv1693433085:86 , srv2027539328:86 , srv2046405351:86 , srv2124222496:86 , srv217919002:86 , srv250503832:86 , srv267721833:86 , srv347252388:86 , srv474825637:86 , srv673058776:86 , srv695108607:86 , srv1020434512:87 , srv1343662445:87 , srv136627228:87 , srv1519393278:87 , srv1643065808:87 , srv1720596550:87 , srv2111292130:87 , srv370889720:87 , srv37135096:87 , srv497914077:87 , srv617104199:87 , srv637729573:87 , srv777016359:87 , srv939128917:87 , srv993120224:87 , srv1003775156:88 , srv1122527352:88 , srv1445477399:88 , srv1462046178:88 , srv1522670776:88 , srv1858800418:88 , srv205447436:88 , srv316613103:88 , srv885073649:88 , srv1304671436:89 , srv1381608244:89 , srv1413069845:89 , srv1508933377:89 , srv1562456375:89 , srv1615439158:89 , srv1760195511:89 , srv312628281:89 , srv365790985:89 , srv59793291:89 , srv656144347:89 , srv765142901:89 , srv788593199:89 , srv1034521105:90 , srv1316911188:90 , srv1853567598:90 , srv300119709:90 , srv790891941:90 , srv935972798:90 , srv945148770:90 , srv528740779:520 }
2023-09-22 22:53:15,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:15,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv256360268=58, srv1473996440=25, srv474825637=69, srv1381608244=18, srv300119709=61, srv2013599534=47, srv993120224=99, srv857518246=91, srv492524505=70, srv1034521105=3, srv247730604=56, srv617104199=78, srv365790985=65, srv777016359=85, srv1563668485=34, srv637729573=79, srv497914077=71, srv2027539328=48, srv765142901=84, srv316613103=63, srv945148770=97, srv666539297=81, srv1108142196=6, srv376520052=68, srv148154258=27, srv1304671436=12, srv1832342599=43, srv1316911188=15, srv695108607=83, srv1245285981=9, srv1858800418=45, srv656144347=80, srv217919002=54, srv1939231752=46, srv1519393278=30, srv790891941=87, srv1462046178=24, srv136627228=17, srv1003775156=0, srv885073649=92, srv1773059410=42, srv885801927=93, srv547038002=75, srv1853567598=44, srv1615439158=37, srv2144462495=53, srv1316493914=14, srv1343662445=16, srv1020434512=2, srv1601473981=36, srv370889720=66, srv287947693=60, srv1445477399=23, srv673058776=82, srv347252388=64, srv1506503364=28, srv1693433085=39, srv205447436=50, srv1481345753=26, srv1444823510=22, srv1567514117=35, srv312628281=62, srv1562456375=33, srv825929446=89, srv963780140=98, srv1167127222=8, srv528740779=74, srv37135096=67, srv1413069845=21, srv1720596550=40, srv1069410438=4, srv2111292130=51, srv1383241529=19, srv267721833=59, srv788593199=86, srv939128917=96, srv250503832=57, srv59793291=76, srv8506824=90, srv523873102=72, srv6107511=77, srv1091071120=5, srv1522670776=31, srv1760195511=41, srv1280364230=11, srv244287568=55, srv1532366187=32, srv935972798=95, srv1312957374=13, srv1508933377=29, srv793219357=88, srv1122527352=7, srv2124222496=52, srv1408359084=20, srv1253623317=10, srv929294923=94, srv1008468205=1, srv528067601=73, srv2046405351=49, srv1643065808=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:15,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:15,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:15,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-22 22:53:15,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-22 22:53:15,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-22 22:53:15,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-22 22:53:15,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-22 22:53:15,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-22 22:53:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-22 22:53:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-22 22:53:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-22 22:53:16,218 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0221626586701954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028950982219826407, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0221626586701954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:16,218 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-22 22:53:16,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015294187937182924, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0221626586701954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.028950982219826407, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0221626586701954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-22 22:53:16,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 570 ms to try 5000 different iterations.  Found a solution that moves 1059 regions; Going from a computed imbalance of 0.015294187937182924 to a new imbalance of 6.088102944278636E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005768100330189269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.11766666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005768100330189269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:16,587 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv935972798:81 , srv945148770:82 , srv1304671436:83 , srv1316493914:83 , srv1408359084:83 , srv1481345753:83 , srv1562456375:83 , srv267721833:83 , srv287947693:83 , srv37135096:83 , srv788593199:83 , srv1034521105:84 , srv136627228:84 , srv1508933377:84 , srv1532366187:84 , srv1760195511:84 , srv1853567598:84 , srv2027539328:84 , srv247730604:84 , srv300119709:84 , srv312628281:84 , srv474825637:84 , srv547038002:84 , srv673058776:84 , srv793219357:84 , srv1003775156:85 , srv1020434512:85 , srv1122527352:85 , srv1245285981:85 , srv1316911188:85 , srv1413069845:85 , srv1445477399:85 , srv1601473981:85 , srv1615439158:85 , srv1693433085:85 , srv205447436:85 , srv2111292130:85 , srv2144462495:85 , srv347252388:85 , srv365790985:85 , srv370889720:85 , srv497914077:85 , srv59793291:85 , srv637729573:85 , srv656144347:85 , srv790891941:85 , srv825929446:85 , srv885073649:85 , srv1108142196:86 , srv1253623317:86 , srv1280364230:86 , srv1312957374:86 , srv1343662445:86 , srv1383241529:86 , srv1462046178:86 , srv1473996440:86 , srv148154258:86 , srv1522670776:86 , srv1563668485:86 , srv1643065808:86 , srv217919002:86 , srv316613103:86 , srv492524505:86 , srv528067601:86 , srv617104199:86 , srv765142901:86 , srv777016359:86 , srv8506824:86 , srv885801927:86 , srv929294923:86 , srv993120224:86 , srv1008468205:87 , srv1069410438:87 , srv1091071120:87 , srv1167127222:87 , srv1381608244:87 , srv1444823510:87 , srv1720596550:87 , srv1858800418:87 , srv1939231752:87 , srv2013599534:87 , srv244287568:87 , srv250503832:87 , srv256360268:87 , srv376520052:87 , srv523873102:87 , srv6107511:87 , srv666539297:87 , srv695108607:87 , srv857518246:87 , srv939128917:87 , srv963780140:87 , srv1506503364:88 , srv1519393278:88 , srv1567514117:88 , srv1773059410:88 , srv1832342599:88 , srv2046405351:88 , srv2124222496:88 , srv528740779:538 }
2023-09-22 22:53:16,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:16,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv256360268=58, srv1473996440=25, srv474825637=69, srv1381608244=18, srv300119709=61, srv2013599534=47, srv993120224=99, srv857518246=91, srv492524505=70, srv1034521105=3, srv247730604=56, srv617104199=78, srv365790985=65, srv777016359=85, srv1563668485=34, srv637729573=79, srv497914077=71, srv2027539328=48, srv765142901=84, srv316613103=63, srv945148770=97, srv666539297=81, srv1108142196=6, srv376520052=68, srv148154258=27, srv1304671436=12, srv1832342599=43, srv1316911188=15, srv695108607=83, srv1245285981=9, srv1858800418=45, srv656144347=80, srv217919002=54, srv1939231752=46, srv1519393278=30, srv790891941=87, srv1462046178=24, srv136627228=17, srv1003775156=0, srv885073649=92, srv1773059410=42, srv885801927=93, srv547038002=75, srv1853567598=44, srv1615439158=37, srv2144462495=53, srv1316493914=14, srv1343662445=16, srv1020434512=2, srv1601473981=36, srv370889720=66, srv287947693=60, srv1445477399=23, srv673058776=82, srv347252388=64, srv1506503364=28, srv1693433085=39, srv205447436=50, srv1481345753=26, srv1444823510=22, srv1567514117=35, srv312628281=62, srv1562456375=33, srv825929446=89, srv963780140=98, srv1167127222=8, srv528740779=74, srv37135096=67, srv1413069845=21, srv1720596550=40, srv1069410438=4, srv2111292130=51, srv1383241529=19, srv267721833=59, srv788593199=86, srv939128917=96, srv250503832=57, srv59793291=76, srv8506824=90, srv523873102=72, srv6107511=77, srv1091071120=5, srv1522670776=31, srv1760195511=41, srv1280364230=11, srv244287568=55, srv1532366187=32, srv935972798=95, srv1312957374=13, srv1508933377=29, srv793219357=88, srv1122527352=7, srv2124222496=52, srv1408359084=20, srv1253623317=10, srv929294923=94, srv1008468205=1, srv528067601=73, srv2046405351=49, srv1643065808=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:16,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:16,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:16,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:16,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-22 22:53:16,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-22 22:53:16,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-22 22:53:16,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-22 22:53:16,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-22 22:53:16,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-22 22:53:16,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-22 22:53:16,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-22 22:53:16,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-22 22:53:16,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-22 22:53:16,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005768100330189269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005768100330189269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:16,793 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-22 22:53:16,793 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.013950179379812E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005768100330189269); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005768100330189269); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-22 22:53:17,159 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 510 ms to try 5000 different iterations.  Found a solution that moves 223 regions; Going from a computed imbalance of 6.013950179379812E-4 to a new imbalance of 1.890464579877301E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.024777777777777777); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:17,160 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1253623317:83 , srv1381608244:83 , srv2046405351:83 , srv492524505:83 , srv6107511:83 , srv963780140:83 , srv1020434512:84 , srv1069410438:84 , srv1091071120:84 , srv1108142196:84 , srv1122527352:84 , srv1167127222:84 , srv1245285981:84 , srv1280364230:84 , srv1383241529:84 , srv1444823510:84 , srv1445477399:84 , srv148154258:84 , srv1506503364:84 , srv1519393278:84 , srv1563668485:84 , srv1643065808:84 , srv1693433085:84 , srv1773059410:84 , srv1832342599:84 , srv1858800418:84 , srv2013599534:84 , srv2124222496:84 , srv2144462495:84 , srv217919002:84 , srv250503832:84 , srv267721833:84 , srv287947693:84 , srv300119709:84 , srv312628281:84 , srv316613103:84 , srv347252388:84 , srv365790985:84 , srv523873102:84 , srv547038002:84 , srv666539297:84 , srv695108607:84 , srv765142901:84 , srv790891941:84 , srv825929446:84 , srv857518246:84 , srv939128917:84 , srv993120224:84 , srv1003775156:85 , srv1034521105:85 , srv1304671436:85 , srv1312957374:85 , srv1316911188:85 , srv1343662445:85 , srv1413069845:85 , srv1462046178:85 , srv1473996440:85 , srv1481345753:85 , srv1508933377:85 , srv1522670776:85 , srv1532366187:85 , srv1562456375:85 , srv1567514117:85 , srv1601473981:85 , srv1615439158:85 , srv1720596550:85 , srv1853567598:85 , srv1939231752:85 , srv2027539328:85 , srv205447436:85 , srv2111292130:85 , srv244287568:85 , srv247730604:85 , srv256360268:85 , srv370889720:85 , srv37135096:85 , srv376520052:85 , srv474825637:85 , srv497914077:85 , srv528067601:85 , srv59793291:85 , srv617104199:85 , srv637729573:85 , srv656144347:85 , srv673058776:85 , srv777016359:85 , srv788593199:85 , srv793219357:85 , srv8506824:85 , srv885073649:85 , srv929294923:85 , srv935972798:85 , srv945148770:85 , srv1008468205:86 , srv1316493914:86 , srv136627228:86 , srv1408359084:86 , srv1760195511:86 , srv885801927:86 , srv528740779:633 }
2023-09-22 22:53:17,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:17,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv256360268=58, srv1473996440=25, srv474825637=69, srv1381608244=18, srv300119709=61, srv2013599534=47, srv993120224=99, srv857518246=91, srv492524505=70, srv1034521105=3, srv247730604=56, srv617104199=78, srv365790985=65, srv777016359=85, srv1563668485=34, srv637729573=79, srv497914077=71, srv2027539328=48, srv765142901=84, srv316613103=63, srv945148770=97, srv666539297=81, srv1108142196=6, srv376520052=68, srv148154258=27, srv1304671436=12, srv1832342599=43, srv1316911188=15, srv695108607=83, srv1245285981=9, srv1858800418=45, srv656144347=80, srv217919002=54, srv1939231752=46, srv1519393278=30, srv790891941=87, srv1462046178=24, srv136627228=17, srv1003775156=0, srv885073649=92, srv1773059410=42, srv885801927=93, srv547038002=75, srv1853567598=44, srv1615439158=37, srv2144462495=53, srv1316493914=14, srv1343662445=16, srv1020434512=2, srv1601473981=36, srv370889720=66, srv287947693=60, srv1445477399=23, srv673058776=82, srv347252388=64, srv1506503364=28, srv1693433085=39, srv205447436=50, srv1481345753=26, srv1444823510=22, srv1567514117=35, srv312628281=62, srv1562456375=33, srv825929446=89, srv963780140=98, srv1167127222=8, srv528740779=74, srv37135096=67, srv1413069845=21, srv1720596550=40, srv1069410438=4, srv2111292130=51, srv1383241529=19, srv267721833=59, srv788593199=86, srv939128917=96, srv250503832=57, srv59793291=76, srv8506824=90, srv523873102=72, srv6107511=77, srv1091071120=5, srv1522670776=31, srv1760195511=41, srv1280364230=11, srv244287568=55, srv1532366187=32, srv935972798=95, srv1312957374=13, srv1508933377=29, srv793219357=88, srv1122527352=7, srv2124222496=52, srv1408359084=20, srv1253623317=10, srv929294923=94, srv1008468205=1, srv528067601=73, srv2046405351=49, srv1643065808=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:17,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:17,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-22 22:53:17,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-22 22:53:17,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-22 22:53:17,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-22 22:53:17,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-22 22:53:17,291 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.734316642460514E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:17,292 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1253623317:83 , srv1381608244:83 , srv2046405351:83 , srv492524505:83 , srv6107511:83 , srv963780140:83 , srv1020434512:84 , srv1069410438:84 , srv1091071120:84 , srv1108142196:84 , srv1122527352:84 , srv1167127222:84 , srv1245285981:84 , srv1280364230:84 , srv1383241529:84 , srv1444823510:84 , srv1445477399:84 , srv148154258:84 , srv1506503364:84 , srv1519393278:84 , srv1563668485:84 , srv1643065808:84 , srv1693433085:84 , srv1773059410:84 , srv1832342599:84 , srv1858800418:84 , srv2013599534:84 , srv2124222496:84 , srv2144462495:84 , srv217919002:84 , srv250503832:84 , srv267721833:84 , srv287947693:84 , srv300119709:84 , srv312628281:84 , srv316613103:84 , srv347252388:84 , srv365790985:84 , srv523873102:84 , srv547038002:84 , srv666539297:84 , srv695108607:84 , srv765142901:84 , srv790891941:84 , srv825929446:84 , srv857518246:84 , srv939128917:84 , srv993120224:84 , srv1003775156:85 , srv1034521105:85 , srv1304671436:85 , srv1312957374:85 , srv1316911188:85 , srv1343662445:85 , srv1413069845:85 , srv1462046178:85 , srv1473996440:85 , srv1481345753:85 , srv1508933377:85 , srv1522670776:85 , srv1532366187:85 , srv1562456375:85 , srv1567514117:85 , srv1601473981:85 , srv1615439158:85 , srv1720596550:85 , srv1853567598:85 , srv1939231752:85 , srv2027539328:85 , srv205447436:85 , srv2111292130:85 , srv244287568:85 , srv247730604:85 , srv256360268:85 , srv370889720:85 , srv37135096:85 , srv376520052:85 , srv474825637:85 , srv497914077:85 , srv528067601:85 , srv59793291:85 , srv617104199:85 , srv637729573:85 , srv656144347:85 , srv673058776:85 , srv777016359:85 , srv788593199:85 , srv793219357:85 , srv8506824:85 , srv885073649:85 , srv929294923:85 , srv935972798:85 , srv945148770:85 , srv1008468205:86 , srv1316493914:86 , srv136627228:86 , srv1408359084:86 , srv1760195511:86 , srv885801927:86 , srv528740779:633 }
2023-09-22 22:53:17,318 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 329), ProcessCount=171 (was 171), AvailableMemoryMB=2437 (was 3074)
2023-09-22 22:53:17,328 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=171, AvailableMemoryMB=2437
2023-09-22 22:53:17,329 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-22 22:53:17,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-22 22:53:17,341 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1068870830:84 , srv1102753376:84 , srv1187718721:84 , srv128889159:84 , srv1514052992:84 , srv1770071886:84 , srv1841544969:84 , srv1888499350:84 , srv1897877395:84 , srv1936555604:84 , srv1961825777:84 , srv2055030439:84 , srv2056509030:84 , srv22900662:84 , srv289622776:84 , srv2939802:84 , srv371693028:84 , srv457467032:84 , srv495958948:84 , srv60083344:84 , srv630013426:84 , srv665521548:84 , srv706573476:84 , srv77899210:84 , srv837764141:84 , srv839922693:84 , srv912183001:84 , srv913150795:84 , srv99605577:84 , srv1991811853:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-22 22:53:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:53:17,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1897877395=8, srv665521548=22, srv706573476=23, srv1187718721=2, srv1514052992=4, srv2056509030=13, srv1936555604=9, srv630013426=21, srv839922693=26, srv1991811853=11, srv1770071886=5, srv99605577=29, srv1888499350=7, srv913150795=28, srv1841544969=6, srv912183001=27, srv1102753376=1, srv289622776=15, srv60083344=20, srv495958948=19, srv2055030439=12, srv837764141=25, srv371693028=17, srv457467032=18, srv77899210=24, srv1961825777=10, srv2939802=16, srv1068870830=0, srv128889159=3, srv22900662=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:53:17,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:53:17,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-22 22:53:17,371 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.198889168864405, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:53:17,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912819736541041, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.198889168864405, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-22 22:55:17,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5713956 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912819736541041 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:55:17,365 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1068870830:90 , srv1102753376:90 , srv1187718721:90 , srv128889159:90 , srv1514052992:90 , srv1770071886:90 , srv1841544969:90 , srv1888499350:90 , srv1897877395:90 , srv1936555604:90 , srv1961825777:90 , srv1991811853:90 , srv2055030439:90 , srv2056509030:90 , srv22900662:90 , srv289622776:90 , srv2939802:90 , srv371693028:90 , srv457467032:90 , srv495958948:90 , srv60083344:90 , srv630013426:90 , srv665521548:90 , srv706573476:90 , srv77899210:90 , srv837764141:90 , srv839922693:90 , srv912183001:90 , srv913150795:90 , srv99605577:90 }
2023-09-22 22:55:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-22 22:55:17,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1897877395=8, srv665521548=22, srv706573476=23, srv1187718721=2, srv1514052992=4, srv2056509030=13, srv1936555604=9, srv630013426=21, srv839922693=26, srv1991811853=11, srv1770071886=5, srv99605577=29, srv1888499350=7, srv913150795=28, srv1841544969=6, srv912183001=27, srv1102753376=1, srv289622776=15, srv60083344=20, srv495958948=19, srv2055030439=12, srv837764141=25, srv371693028=17, srv457467032=18, srv77899210=24, srv1961825777=10, srv2939802=16, srv1068870830=0, srv128889159=3, srv22900662=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-22 22:55:17,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-22 22:55:17,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-22 22:55:17,383 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-22 22:55:17,383 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1068870830:90 , srv1102753376:90 , srv1187718721:90 , srv128889159:90 , srv1514052992:90 , srv1770071886:90 , srv1841544969:90 , srv1888499350:90 , srv1897877395:90 , srv1936555604:90 , srv1961825777:90 , srv1991811853:90 , srv2055030439:90 , srv2056509030:90 , srv22900662:90 , srv289622776:90 , srv2939802:90 , srv371693028:90 , srv457467032:90 , srv495958948:90 , srv60083344:90 , srv630013426:90 , srv665521548:90 , srv706573476:90 , srv77899210:90 , srv837764141:90 , srv839922693:90 , srv912183001:90 , srv913150795:90 , srv99605577:90 }
2023-09-22 22:55:17,395 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 329), ProcessCount=170 (was 171), AvailableMemoryMB=1758 (was 2437)