2023-11-17 03:57:24,656 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-17 03:57:24,975 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-17 03:57:25,090 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-17 03:57:25,159 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 03:57:25,166 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-17 03:57:25,179 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=167, AvailableMemoryMB=7455
2023-11-17 03:57:25,181 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 03:57:25,181 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-17 03:57:25,325 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004237515:84 , srv1094909065:84 , srv1096500283:84 , srv1115887487:84 , srv1122606672:84 , srv1122969768:84 , srv1133382032:84 , srv1146202703:84 , srv1149542647:84 , srv1170553158:84 , srv1174647197:84 , srv1175048217:84 , srv1180228831:84 , srv1210734609:84 , srv1213195245:84 , srv1213587888:84 , srv1306456102:84 , srv1312699272:84 , srv1313039101:84 , srv1357320355:84 , srv1364271597:84 , srv1385886528:84 , srv1398736453:84 , srv1424848475:84 , srv1442001798:84 , srv1463663381:84 , srv1477228771:84 , srv1493166512:84 , srv1534629249:84 , srv1556666390:84 , srv1559587257:84 , srv1597647503:84 , srv1607593060:84 , srv1620332245:84 , srv1673629571:84 , srv1689020617:84 , srv1713817915:84 , srv1753768540:84 , srv175473990:84 , srv177439883:84 , srv1814571282:84 , srv1843675103:84 , srv1920345656:84 , srv1934183321:84 , srv1935297935:84 , srv2000577318:84 , srv201109590:84 , srv2090031838:84 , srv2103994030:84 , srv223547102:84 , srv230505737:84 , srv258096079:84 , srv291571940:84 , srv299830943:84 , srv314237604:84 , srv334603757:84 , srv353474390:84 , srv367942741:84 , srv3885463:84 , srv389493663:84 , srv407465101:84 , srv423062828:84 , srv423868200:84 , srv426183907:84 , srv428645325:84 , srv481781474:84 , srv490891386:84 , srv497661280:84 , srv523088637:84 , srv535973461:84 , srv557250888:84 , srv558910043:84 , srv57070900:84 , srv577598405:84 , srv580650205:84 , srv625162810:84 , srv631790273:84 , srv638587300:84 , srv642526330:84 , srv669338408:84 , srv675923151:84 , srv680722235:84 , srv702144943:84 , srv714370266:84 , srv718139855:84 , srv768920588:84 , srv777386100:84 , srv787264697:84 , srv788925138:84 , srv793389530:84 , srv830980889:84 , srv845793023:84 , srv866046188:84 , srv869860069:84 , srv891075133:84 , srv900335251:84 , srv922435673:84 , srv963967035:84 , srv96787152:84 , srv1480746148:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-17 03:57:25,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:25,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:25,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:25,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:25,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:25,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:25,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:25,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:25,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:25,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:25,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:25,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:25,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:25,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:25,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:25,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:25,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:25,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:25,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:25,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:25,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:25,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:25,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:25,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:25,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:25,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:25,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:25,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:25,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:25,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:25,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:25,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:25,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:25,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:25,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:25,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:25,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:25,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:25,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:25,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:25,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:25,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:25,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:25,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:25,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:25,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:25,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:25,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:25,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:25,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:25,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:25,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:25,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:25,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:25,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:25,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:25,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:25,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:25,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:25,801 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 03:57:25,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 03:57:26,440 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 935 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17982904215210443. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239347395818926, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05876201312333946, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239347395818926, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:26,451 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1620332245:82 , srv577598405:82 , srv1122606672:83 , srv1170553158:83 , srv1306456102:83 , srv1385886528:83 , srv2000577318:83 , srv291571940:83 , srv625162810:83 , srv669338408:83 , srv714370266:83 , srv768920588:83 , srv869860069:83 , srv1094909065:84 , srv1115887487:84 , srv1122969768:84 , srv1174647197:84 , srv1210734609:84 , srv1398736453:84 , srv1463663381:84 , srv1607593060:84 , srv407465101:84 , srv702144943:84 , srv793389530:84 , srv1096500283:85 , srv1213195245:85 , srv1313039101:85 , srv1477228771:85 , srv1556666390:85 , srv1559587257:85 , srv177439883:85 , srv1920345656:85 , srv223547102:85 , srv481781474:85 , srv523088637:85 , srv718139855:85 , srv787264697:85 , srv866046188:85 , srv1213587888:86 , srv1493166512:86 , srv1753768540:86 , srv175473990:86 , srv1814571282:86 , srv1843675103:86 , srv1934183321:86 , srv1935297935:86 , srv353474390:86 , srv367942741:86 , srv389493663:86 , srv423868200:86 , srv428645325:86 , srv580650205:86 , srv642526330:86 , srv675923151:86 , srv680722235:86 , srv777386100:86 , srv788925138:86 , srv900335251:86 , srv922435673:86 , srv1133382032:87 , srv1180228831:87 , srv1312699272:87 , srv1364271597:87 , srv1534629249:87 , srv1597647503:87 , srv1673629571:87 , srv2103994030:87 , srv299830943:87 , srv334603757:87 , srv3885463:87 , srv426183907:87 , srv497661280:87 , srv557250888:87 , srv638587300:87 , srv96787152:87 , srv1357320355:88 , srv201109590:88 , srv2090031838:88 , srv258096079:88 , srv314237604:88 , srv490891386:88 , srv558910043:88 , srv57070900:88 , srv845793023:88 , srv891075133:88 , srv963967035:88 , srv1146202703:89 , srv1149542647:89 , srv423062828:89 , srv535973461:89 , srv631790273:89 , srv830980889:89 , srv1442001798:90 , srv1713817915:90 , srv1175048217:91 , srv1689020617:91 , srv1424848475:92 , srv230505737:92 , srv1004237515:96 , srv1480746148:467 }
2023-11-17 03:57:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:26,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:26,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:26,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:26,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:26,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:26,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:26,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:26,657 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239347395818926, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05876201312333946, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239347395818926, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:26,657 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 03:57:26,657 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1797962510852469, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04239347395818926, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05876201312333946, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04239347395818926, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17483333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24358333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 03:57:26,891 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 383 ms to try 5000 different iterations.  Found a solution that moves 2662 regions; Going from a computed imbalance of 0.1797962510852469 to a new imbalance of 0.016657149404287183. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024525424480340608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29577777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024525424480340608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:26,899 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1004237515:76 , srv1424848475:79 , srv230505737:80 , srv1442001798:81 , srv1689020617:81 , srv1146202703:82 , srv1149542647:82 , srv1175048217:82 , srv1534629249:82 , srv423062828:82 , srv558910043:82 , srv891075133:82 , srv1364271597:83 , srv1713817915:83 , srv201109590:83 , srv2090031838:83 , srv490891386:83 , srv535973461:83 , srv57070900:83 , srv631790273:83 , srv963967035:83 , srv1312699272:84 , srv1477228771:84 , srv1493166512:84 , srv1597647503:84 , srv1673629571:84 , srv334603757:84 , srv426183907:84 , srv675923151:84 , srv830980889:84 , srv922435673:84 , srv1133382032:85 , srv1180228831:85 , srv1213195245:85 , srv175473990:85 , srv1814571282:85 , srv1934183321:85 , srv2103994030:85 , srv423868200:85 , srv428645325:85 , srv638587300:85 , srv642526330:85 , srv777386100:85 , srv788925138:85 , srv96787152:85 , srv1115887487:86 , srv1213587888:86 , srv1313039101:86 , srv1357320355:86 , srv1398736453:86 , srv1556666390:86 , srv1559587257:86 , srv1607593060:86 , srv1843675103:86 , srv1920345656:86 , srv291571940:86 , srv299830943:86 , srv314237604:86 , srv367942741:86 , srv389493663:86 , srv497661280:86 , srv523088637:86 , srv557250888:86 , srv866046188:86 , srv1096500283:87 , srv1210734609:87 , srv1463663381:87 , srv1935297935:87 , srv258096079:87 , srv3885463:87 , srv481781474:87 , srv580650205:87 , srv680722235:87 , srv714370266:87 , srv787264697:87 , srv1094909065:88 , srv1122606672:88 , srv1174647197:88 , srv1385886528:88 , srv1753768540:88 , srv177439883:88 , srv2000577318:88 , srv407465101:88 , srv577598405:88 , srv869860069:88 , srv1306456102:89 , srv223547102:89 , srv353474390:89 , srv625162810:89 , srv669338408:89 , srv702144943:89 , srv900335251:89 , srv1122969768:90 , srv1620332245:90 , srv718139855:90 , srv845793023:90 , srv1170553158:91 , srv768920588:91 , srv793389530:91 , srv1480746148:525 }
2023-11-17 03:57:26,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:26,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:26,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:26,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:26,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:26,922 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:26,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:26,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:26,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:26,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:26,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:26,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:26,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:27,033 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024525424480340608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024525424480340608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,033 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 03:57:27,033 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01663850968189241, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024525424480340608); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024525424480340608); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0135); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 03:57:27,213 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 266 ms to try 5000 different iterations.  Found a solution that moves 969 regions; Going from a computed imbalance of 0.01663850968189241 to a new imbalance of 0.0010845960846080458. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009795260362887512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010625763325059502); MoveCostFunction : (multiplier=7.0, imbalance=0.10766666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009795260362887512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,215 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv845793023:80 , srv1753768540:82 , srv353474390:82 , srv793389530:82 , srv1122969768:83 , srv1357320355:83 , srv223547102:83 , srv258096079:83 , srv580650205:83 , srv702144943:83 , srv718139855:83 , srv900335251:83 , srv1096500283:84 , srv1170553158:84 , srv1175048217:84 , srv1689020617:84 , srv1935297935:84 , srv299830943:84 , srv314237604:84 , srv3885463:84 , srv557250888:84 , srv669338408:84 , srv680722235:84 , srv768920588:84 , srv830980889:84 , srv1133382032:85 , srv1174647197:85 , srv1180228831:85 , srv1213587888:85 , srv1306456102:85 , srv1424848475:85 , srv1620332245:85 , srv1673629571:85 , srv1713817915:85 , srv175473990:85 , srv1934183321:85 , srv2000577318:85 , srv2103994030:85 , srv230505737:85 , srv334603757:85 , srv389493663:85 , srv423868200:85 , srv481781474:85 , srv497661280:85 , srv625162810:85 , srv642526330:85 , srv787264697:85 , srv869860069:85 , srv96787152:85 , srv1004237515:86 , srv1094909065:86 , srv1122606672:86 , srv1146202703:86 , srv1149542647:86 , srv1210734609:86 , srv1312699272:86 , srv1313039101:86 , srv1463663381:86 , srv1493166512:86 , srv1556666390:86 , srv1559587257:86 , srv1597647503:86 , srv177439883:86 , srv1814571282:86 , srv1843675103:86 , srv1920345656:86 , srv201109590:86 , srv2090031838:86 , srv367942741:86 , srv407465101:86 , srv423062828:86 , srv426183907:86 , srv428645325:86 , srv535973461:86 , srv558910043:86 , srv57070900:86 , srv631790273:86 , srv638587300:86 , srv788925138:86 , srv866046188:86 , srv963967035:86 , srv1115887487:87 , srv1213195245:87 , srv1385886528:87 , srv1442001798:87 , srv1607593060:87 , srv490891386:87 , srv523088637:87 , srv577598405:87 , srv675923151:87 , srv714370266:87 , srv777386100:87 , srv922435673:87 , srv1364271597:88 , srv1477228771:88 , srv1534629249:88 , srv291571940:88 , srv891075133:88 , srv1398736453:89 , srv1480746148:553 }
2023-11-17 03:57:27,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:27,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:27,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:27,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:27,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:27,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:27,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:27,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:27,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:27,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:27,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:27,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:27,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:27,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:27,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:27,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009795260362887512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010625763325059502); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009795260362887512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,329 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 03:57:27,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0010778110015875586, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009795260362887512); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010625763325059502); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.009795260362887512); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 03:57:27,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 322 ms to try 5000 different iterations.  Found a solution that moves 292 regions; Going from a computed imbalance of 0.0010778110015875586 to a new imbalance of 2.6550223047320205E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.03244444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,572 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1398736453:83 , srv1442001798:83 , srv177439883:83 , srv3885463:83 , srv1004237515:84 , srv1170553158:84 , srv1364271597:84 , srv1385886528:84 , srv1713817915:84 , srv1843675103:84 , srv258096079:84 , srv314237604:84 , srv367942741:84 , srv407465101:84 , srv490891386:84 , srv523088637:84 , srv535973461:84 , srv631790273:84 , srv638587300:84 , srv718139855:84 , srv768920588:84 , srv777386100:84 , srv845793023:84 , srv891075133:84 , srv900335251:84 , srv1094909065:85 , srv1115887487:85 , srv1122606672:85 , srv1122969768:85 , srv1133382032:85 , srv1146202703:85 , srv1149542647:85 , srv1174647197:85 , srv1175048217:85 , srv1180228831:85 , srv1210734609:85 , srv1213195245:85 , srv1213587888:85 , srv1306456102:85 , srv1312699272:85 , srv1313039101:85 , srv1357320355:85 , srv1463663381:85 , srv1477228771:85 , srv1534629249:85 , srv1559587257:85 , srv1597647503:85 , srv1607593060:85 , srv1620332245:85 , srv1814571282:85 , srv1920345656:85 , srv1935297935:85 , srv201109590:85 , srv2090031838:85 , srv2103994030:85 , srv223547102:85 , srv230505737:85 , srv291571940:85 , srv299830943:85 , srv353474390:85 , srv389493663:85 , srv423062828:85 , srv423868200:85 , srv426183907:85 , srv428645325:85 , srv481781474:85 , srv497661280:85 , srv557250888:85 , srv57070900:85 , srv577598405:85 , srv580650205:85 , srv675923151:85 , srv680722235:85 , srv714370266:85 , srv787264697:85 , srv788925138:85 , srv793389530:85 , srv830980889:85 , srv866046188:85 , srv922435673:85 , srv963967035:85 , srv96787152:85 , srv1096500283:86 , srv1424848475:86 , srv1493166512:86 , srv1556666390:86 , srv1673629571:86 , srv1689020617:86 , srv1753768540:86 , srv175473990:86 , srv1934183321:86 , srv2000577318:86 , srv334603757:86 , srv558910043:86 , srv625162810:86 , srv642526330:86 , srv669338408:86 , srv702144943:86 , srv869860069:86 , srv1480746148:597 }
2023-11-17 03:57:27,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:27,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:27,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:27,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:27,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:27,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:27,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:27,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:27,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:27,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:27,675 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,675 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 03:57:27,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4505595346616088E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 03:57:27,850 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 249 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 2.4505595346616088E-5 to a new imbalance of 6.870107747710969E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:27,851 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1094909065:83 , srv1556666390:83 , srv497661280:83 , srv625162810:83 , srv1004237515:84 , srv1096500283:84 , srv1115887487:84 , srv1122606672:84 , srv1122969768:84 , srv1133382032:84 , srv1146202703:84 , srv1149542647:84 , srv1170553158:84 , srv1174647197:84 , srv1175048217:84 , srv1180228831:84 , srv1210734609:84 , srv1213195245:84 , srv1213587888:84 , srv1306456102:84 , srv1312699272:84 , srv1313039101:84 , srv1357320355:84 , srv1364271597:84 , srv1385886528:84 , srv1398736453:84 , srv1424848475:84 , srv1463663381:84 , srv1477228771:84 , srv1493166512:84 , srv1534629249:84 , srv1559587257:84 , srv1597647503:84 , srv1607593060:84 , srv1620332245:84 , srv1673629571:84 , srv1689020617:84 , srv1713817915:84 , srv1753768540:84 , srv175473990:84 , srv177439883:84 , srv1814571282:84 , srv1843675103:84 , srv1920345656:84 , srv1934183321:84 , srv1935297935:84 , srv2000577318:84 , srv201109590:84 , srv2090031838:84 , srv2103994030:84 , srv223547102:84 , srv230505737:84 , srv258096079:84 , srv291571940:84 , srv299830943:84 , srv314237604:84 , srv334603757:84 , srv353474390:84 , srv367942741:84 , srv389493663:84 , srv407465101:84 , srv423062828:84 , srv426183907:84 , srv428645325:84 , srv481781474:84 , srv490891386:84 , srv523088637:84 , srv535973461:84 , srv557250888:84 , srv558910043:84 , srv57070900:84 , srv577598405:84 , srv631790273:84 , srv638587300:84 , srv642526330:84 , srv669338408:84 , srv675923151:84 , srv680722235:84 , srv702144943:84 , srv714370266:84 , srv718139855:84 , srv768920588:84 , srv777386100:84 , srv787264697:84 , srv788925138:84 , srv793389530:84 , srv830980889:84 , srv845793023:84 , srv866046188:84 , srv869860069:84 , srv891075133:84 , srv900335251:84 , srv922435673:84 , srv963967035:84 , srv96787152:84 , srv1442001798:85 , srv3885463:85 , srv423868200:85 , srv580650205:85 , srv1480746148:684 }
2023-11-17 03:57:27,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:27,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv638587300=78, srv175473990=39, srv891075133=95, srv223547102=50, srv787264697=88, srv1935297935=45, srv523088637=69, srv96787152=99, srv1170553158=9, srv718139855=85, srv557250888=71, srv680722235=82, srv1115887487=3, srv1534629249=29, srv1175048217=11, srv2090031838=48, srv1843675103=42, srv1312699272=17, srv1357320355=19, srv1122969768=5, srv1306456102=16, srv177439883=40, srv230505737=51, srv481781474=66, srv1597647503=32, srv299830943=54, srv1313039101=18, srv426183907=64, srv1934183321=44, srv788925138=89, srv1364271597=20, srv2103994030=49, srv389493663=60, srv1174647197=10, srv497661280=68, srv3885463=59, srv1385886528=21, srv490891386=67, srv535973461=70, srv1814571282=41, srv353474390=57, srv1424848475=23, srv1096500283=2, srv1689020617=36, srv793389530=90, srv367942741=58, srv900335251=96, srv1146202703=7, srv57070900=73, srv866046188=93, srv675923151=81, srv423062828=62, srv830980889=91, srv1713817915=37, srv577598405=74, srv1556666390=30, srv1463663381=25, srv714370266=84, srv1753768540=38, srv2000577318=46, srv1213195245=14, srv1398736453=22, srv1607593060=33, srv669338408=80, srv558910043=72, srv201109590=47, srv1442001798=24, srv1122606672=4, srv1480746148=27, srv869860069=94, srv1493166512=28, srv1559587257=31, srv1477228771=26, srv1620332245=34, srv1210734609=13, srv631790273=77, srv1133382032=6, srv1180228831=12, srv922435673=97, srv1920345656=43, srv845793023=92, srv963967035=98, srv291571940=53, srv314237604=55, srv428645325=65, srv1213587888=15, srv258096079=52, srv334603757=56, srv777386100=87, srv1004237515=0, srv407465101=61, srv580650205=75, srv768920588=86, srv1149542647=8, srv625162810=76, srv1094909065=1, srv1673629571=35, srv423868200=63, srv642526330=79, srv702144943=83} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:27,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:27,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:27,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:27,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:27,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 03:57:27,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 03:57:27,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 03:57:27,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 03:57:27,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 03:57:27,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 03:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 03:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 03:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 03:57:27,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 03:57:27,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 03:57:27,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 03:57:27,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 03:57:27,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 03:57:27,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 03:57:27,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 03:57:27,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 03:57:27,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 03:57:28,016 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:28,017 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1094909065:83 , srv1556666390:83 , srv497661280:83 , srv625162810:83 , srv1004237515:84 , srv1096500283:84 , srv1115887487:84 , srv1122606672:84 , srv1122969768:84 , srv1133382032:84 , srv1146202703:84 , srv1149542647:84 , srv1170553158:84 , srv1174647197:84 , srv1175048217:84 , srv1180228831:84 , srv1210734609:84 , srv1213195245:84 , srv1213587888:84 , srv1306456102:84 , srv1312699272:84 , srv1313039101:84 , srv1357320355:84 , srv1364271597:84 , srv1385886528:84 , srv1398736453:84 , srv1424848475:84 , srv1463663381:84 , srv1477228771:84 , srv1493166512:84 , srv1534629249:84 , srv1559587257:84 , srv1597647503:84 , srv1607593060:84 , srv1620332245:84 , srv1673629571:84 , srv1689020617:84 , srv1713817915:84 , srv1753768540:84 , srv175473990:84 , srv177439883:84 , srv1814571282:84 , srv1843675103:84 , srv1920345656:84 , srv1934183321:84 , srv1935297935:84 , srv2000577318:84 , srv201109590:84 , srv2090031838:84 , srv2103994030:84 , srv223547102:84 , srv230505737:84 , srv258096079:84 , srv291571940:84 , srv299830943:84 , srv314237604:84 , srv334603757:84 , srv353474390:84 , srv367942741:84 , srv389493663:84 , srv407465101:84 , srv423062828:84 , srv426183907:84 , srv428645325:84 , srv481781474:84 , srv490891386:84 , srv523088637:84 , srv535973461:84 , srv557250888:84 , srv558910043:84 , srv57070900:84 , srv577598405:84 , srv631790273:84 , srv638587300:84 , srv642526330:84 , srv669338408:84 , srv675923151:84 , srv680722235:84 , srv702144943:84 , srv714370266:84 , srv718139855:84 , srv768920588:84 , srv777386100:84 , srv787264697:84 , srv788925138:84 , srv793389530:84 , srv830980889:84 , srv845793023:84 , srv866046188:84 , srv869860069:84 , srv891075133:84 , srv900335251:84 , srv922435673:84 , srv963967035:84 , srv96787152:84 , srv1442001798:85 , srv3885463:85 , srv423868200:85 , srv580650205:85 , srv1480746148:684 }
2023-11-17 03:57:28,040 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 283), ProcessCount=167 (was 167), AvailableMemoryMB=6928 (was 7455)
2023-11-17 03:57:28,049 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=167, AvailableMemoryMB=6928
2023-11-17 03:57:28,050 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 03:57:28,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-17 03:57:28,058 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048447960:84 , srv1049381353:84 , srv1065185732:84 , srv1275352658:84 , srv1306265633:84 , srv1316245580:84 , srv1319722420:84 , srv1450801917:84 , srv1737004589:84 , srv1811997821:84 , srv1858868411:84 , srv2006236294:84 , srv20192924:84 , srv2037639797:84 , srv2056396800:84 , srv2067100962:84 , srv252275182:84 , srv31034851:84 , srv324458476:84 , srv335711018:84 , srv336522676:84 , srv482828810:84 , srv522676776:84 , srv539745430:84 , srv643751924:84 , srv840964005:84 , srv856701505:84 , srv935028848:84 , srv978285280:84 , srv1660563946:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-17 03:57:28,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:57:28,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv31034851=18, srv2006236294=12, srv643751924=25, srv539745430=24, srv1065185732=2, srv2067100962=16, srv840964005=26, srv935028848=28, srv1450801917=7, srv1660563946=8, srv335711018=20, srv1306265633=4, srv324458476=19, srv1316245580=5, srv1275352658=3, srv1858868411=11, srv522676776=23, srv1737004589=9, srv20192924=13, srv2037639797=14, srv1048447960=0, srv978285280=29, srv336522676=21, srv1811997821=10, srv252275182=17, srv856701505=27, srv1049381353=1, srv482828810=22, srv1319722420=6, srv2056396800=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:57:28,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:57:28,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:57:28,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:57:28,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-17 03:57:28,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1369262962208477, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:57:28,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912624493552616, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1369262962208477, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-17 03:59:28,078 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9293853 different iterations.  Found a solution that moves 1842 regions; Going from a computed imbalance of 0.9912624493552616 to a new imbalance of 4.2993198912066E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:59:28,084 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048447960:90 , srv1049381353:90 , srv1065185732:90 , srv1275352658:90 , srv1306265633:90 , srv1316245580:90 , srv1319722420:90 , srv1450801917:90 , srv1660563946:90 , srv1737004589:90 , srv1811997821:90 , srv1858868411:90 , srv2006236294:90 , srv20192924:90 , srv2037639797:90 , srv2056396800:90 , srv2067100962:90 , srv252275182:90 , srv31034851:90 , srv324458476:90 , srv335711018:90 , srv336522676:90 , srv482828810:90 , srv522676776:90 , srv539745430:90 , srv643751924:90 , srv840964005:90 , srv856701505:90 , srv935028848:90 , srv978285280:90 }
2023-11-17 03:59:28,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 03:59:28,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv31034851=18, srv2006236294=12, srv643751924=25, srv539745430=24, srv1065185732=2, srv2067100962=16, srv840964005=26, srv935028848=28, srv1450801917=7, srv1660563946=8, srv335711018=20, srv1306265633=4, srv324458476=19, srv1316245580=5, srv1275352658=3, srv1858868411=11, srv522676776=23, srv1737004589=9, srv20192924=13, srv2037639797=14, srv1048447960=0, srv978285280=29, srv336522676=21, srv1811997821=10, srv252275182=17, srv856701505=27, srv1049381353=1, srv482828810=22, srv1319722420=6, srv2056396800=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 03:59:28,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 03:59:28,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 03:59:28,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 03:59:28,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 03:59:28,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 03:59:28,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-17 03:59:28,099 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 03:59:28,099 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048447960:90 , srv1049381353:90 , srv1065185732:90 , srv1275352658:90 , srv1306265633:90 , srv1316245580:90 , srv1319722420:90 , srv1450801917:90 , srv1660563946:90 , srv1737004589:90 , srv1811997821:90 , srv1858868411:90 , srv2006236294:90 , srv20192924:90 , srv2037639797:90 , srv2056396800:90 , srv2067100962:90 , srv252275182:90 , srv31034851:90 , srv324458476:90 , srv335711018:90 , srv336522676:90 , srv482828810:90 , srv522676776:90 , srv539745430:90 , srv643751924:90 , srv840964005:90 , srv856701505:90 , srv935028848:90 , srv978285280:90 }
2023-11-17 03:59:28,110 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 276), ProcessCount=165 (was 167), AvailableMemoryMB=6668 (was 6928)