2023-10-14 06:53:31,308 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-14 06:53:31,622 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-14 06:53:31,742 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-14 06:53:31,812 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-14 06:53:31,819 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-14 06:53:31,833 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=411, ProcessCount=171, AvailableMemoryMB=2679
2023-10-14 06:53:31,836 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-14 06:53:31,836 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-14 06:53:31,978 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100160924:84 , srv1007256502:84 , srv1019886661:84 , srv1037792229:84 , srv1079166157:84 , srv1088302742:84 , srv1093992961:84 , srv1133096553:84 , srv1146040080:84 , srv1153707741:84 , srv1161289265:84 , srv1165307793:84 , srv1165734929:84 , srv116603381:84 , srv1176156791:84 , srv1186764313:84 , srv125698735:84 , srv1272723645:84 , srv1278044074:84 , srv1307278887:84 , srv1310538112:84 , srv1316823714:84 , srv1340137645:84 , srv1344910384:84 , srv1354681736:84 , srv135669498:84 , srv1357719121:84 , srv1418221916:84 , srv1422702273:84 , srv1468841750:84 , srv14728130:84 , srv1489627430:84 , srv15037375:84 , srv1518460040:84 , srv1524799962:84 , srv1525259022:84 , srv1559047967:84 , srv1561223186:84 , srv1572013589:84 , srv1585601312:84 , srv1596736973:84 , srv1598088188:84 , srv1624150549:84 , srv1677934476:84 , srv1700650734:84 , srv1737787307:84 , srv1759588979:84 , srv1812366272:84 , srv1822849539:84 , srv1855351804:84 , srv1867845108:84 , srv1882297241:84 , srv1896486644:84 , srv1923572273:84 , srv19535939:84 , srv1983488104:84 , srv2048963568:84 , srv2076356314:84 , srv2132353990:84 , srv235982887:84 , srv253903595:84 , srv263702680:84 , srv280887136:84 , srv317581669:84 , srv331732954:84 , srv34559628:84 , srv440501117:84 , srv458343684:84 , srv465162940:84 , srv474528198:84 , srv489892980:84 , srv536558823:84 , srv566576070:84 , srv603032703:84 , srv613103201:84 , srv643136802:84 , srv648109339:84 , srv664003805:84 , srv670313192:84 , srv699025528:84 , srv699747582:84 , srv723403826:84 , srv749649752:84 , srv760217879:84 , srv766862922:84 , srv768601946:84 , srv797745113:84 , srv803472365:84 , srv809125382:84 , srv819204809:84 , srv860957418:84 , srv873506596:84 , srv911102041:84 , srv929414151:84 , srv934560305:84 , srv937456508:84 , srv953308857:84 , srv963894569:84 , srv980666244:84 , srv608728820:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-14 06:53:31,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:32,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1310538112=20, srv723403826=82, srv1882297241=51, srv1088302742=5, srv1340137645=22, srv1316823714=21, srv1867845108=50, srv1525259022=35, srv648109339=77, srv1161289265=10, srv699025528=80, srv331732954=64, srv768601946=86, srv1418221916=27, srv613103201=75, srv937456508=96, srv963894569=98, srv953308857=97, srv2132353990=58, srv1354681736=24, srv797745113=87, srv766862922=85, srv34559628=65, srv809125382=89, srv1165734929=12, srv664003805=78, srv860957418=91, srv1677934476=43, srv458343684=67, srv911102041=93, srv1186764313=15, srv760217879=84, srv135669498=25, srv1759588979=46, srv100160924=0, srv1079166157=4, srv1596736973=40, srv1357719121=26, srv1468841750=29, srv1855351804=49, srv19535939=54, srv980666244=99, srv1896486644=52, srv465162940=68, srv1559047967=36, srv1585601312=39, srv263702680=61, srv929414151=94, srv440501117=66, srv1737787307=45, srv1923572273=53, srv1489627430=31, srv1037792229=3, srv749649752=83, srv1344910384=23, srv1093992961=6, srv253903595=60, srv1019886661=2, srv1518460040=33, srv2076356314=57, srv125698735=16, srv1561223186=37, srv1524799962=34, srv1007256502=1, srv1812366272=47, srv1272723645=17, srv536558823=71, srv1176156791=14, srv1624150549=42, srv235982887=59, srv1133096553=7, srv1153707741=9, srv116603381=13, srv603032703=73, srv1278044074=18, srv317581669=63, srv2048963568=56, srv14728130=30, srv670313192=79, srv15037375=32, srv1598088188=41, srv643136802=76, srv803472365=88, srv1422702273=28, srv873506596=92, srv1307278887=19, srv699747582=81, srv1165307793=11, srv280887136=62, srv566576070=72, srv1983488104=55, srv1146040080=8, srv489892980=70, srv1700650734=44, srv934560305=95, srv819204809=90, srv608728820=74, srv474528198=69, srv1572013589=38, srv1822849539=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:32,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:32,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:32,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:32,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:32,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-14 06:53:32,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-14 06:53:32,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-14 06:53:32,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-14 06:53:32,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-14 06:53:32,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-14 06:53:32,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-14 06:53:32,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-14 06:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-14 06:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-14 06:53:32,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-14 06:53:32,522 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:32,522 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-14 06:53:32,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-14 06:53:32,960 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 819 ms to try 5000 different iterations.  Found a solution that moves 4709 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17638369798584824. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038380677996184664, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05761827244776886, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5232222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038380677996184664, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:32,977 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv566576070:81 , srv1146040080:82 , srv1307278887:82 , srv1896486644:82 , srv643136802:82 , srv860957418:82 , srv1007256502:83 , srv1037792229:83 , srv1153707741:83 , srv1316823714:83 , srv1525259022:83 , srv19535939:83 , srv536558823:83 , srv766862922:83 , srv1133096553:84 , srv1422702273:84 , srv1598088188:84 , srv1700650734:84 , srv1882297241:84 , srv317581669:84 , srv768601946:84 , srv803472365:84 , srv1088302742:85 , srv1165734929:85 , srv125698735:85 , srv1278044074:85 , srv1310538112:85 , srv1489627430:85 , srv15037375:85 , srv1559047967:85 , srv1677934476:85 , srv1737787307:85 , srv1759588979:85 , srv1855351804:85 , srv331732954:85 , srv963894569:85 , srv980666244:85 , srv116603381:86 , srv1272723645:86 , srv1344910384:86 , srv135669498:86 , srv1357719121:86 , srv1418221916:86 , srv14728130:86 , srv253903595:86 , srv458343684:86 , srv648109339:86 , srv670313192:86 , srv934560305:86 , srv1165307793:87 , srv1354681736:87 , srv1572013589:87 , srv1983488104:87 , srv2048963568:87 , srv2076356314:87 , srv280887136:87 , srv603032703:87 , srv699025528:87 , srv699747582:87 , srv819204809:87 , srv873506596:87 , srv937456508:87 , srv953308857:87 , srv1019886661:88 , srv1176156791:88 , srv1518460040:88 , srv1561223186:88 , srv1585601312:88 , srv235982887:88 , srv465162940:88 , srv749649752:88 , srv100160924:89 , srv1079166157:89 , srv1186764313:89 , srv1340137645:89 , srv1524799962:89 , srv1596736973:89 , srv1822849539:89 , srv1923572273:89 , srv263702680:89 , srv440501117:89 , srv613103201:89 , srv723403826:89 , srv760217879:89 , srv911102041:89 , srv929414151:89 , srv1093992961:90 , srv1161289265:90 , srv1468841750:90 , srv1624150549:90 , srv1812366272:90 , srv34559628:90 , srv474528198:90 , srv489892980:90 , srv664003805:90 , srv797745113:90 , srv1867845108:92 , srv2132353990:92 , srv809125382:94 , srv608728820:431 }
2023-10-14 06:53:32,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:32,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1310538112=20, srv723403826=82, srv1882297241=51, srv1088302742=5, srv1340137645=22, srv1316823714=21, srv1867845108=50, srv1525259022=35, srv648109339=77, srv1161289265=10, srv699025528=80, srv331732954=64, srv768601946=86, srv1418221916=27, srv613103201=75, srv937456508=96, srv963894569=98, srv953308857=97, srv2132353990=58, srv1354681736=24, srv797745113=87, srv766862922=85, srv34559628=65, srv809125382=89, srv1165734929=12, srv664003805=78, srv860957418=91, srv1677934476=43, srv458343684=67, srv911102041=93, srv1186764313=15, srv760217879=84, srv135669498=25, srv1759588979=46, srv100160924=0, srv1079166157=4, srv1596736973=40, srv1357719121=26, srv1468841750=29, srv1855351804=49, srv19535939=54, srv980666244=99, srv1896486644=52, srv465162940=68, srv1559047967=36, srv1585601312=39, srv263702680=61, srv929414151=94, srv440501117=66, srv1737787307=45, srv1923572273=53, srv1489627430=31, srv1037792229=3, srv749649752=83, srv1344910384=23, srv1093992961=6, srv253903595=60, srv1019886661=2, srv1518460040=33, srv2076356314=57, srv125698735=16, srv1561223186=37, srv1524799962=34, srv1007256502=1, srv1812366272=47, srv1272723645=17, srv536558823=71, srv1176156791=14, srv1624150549=42, srv235982887=59, srv1133096553=7, srv1153707741=9, srv116603381=13, srv603032703=73, srv1278044074=18, srv317581669=63, srv2048963568=56, srv14728130=30, srv670313192=79, srv15037375=32, srv1598088188=41, srv643136802=76, srv803472365=88, srv1422702273=28, srv873506596=92, srv1307278887=19, srv699747582=81, srv1165307793=11, srv280887136=62, srv566576070=72, srv1983488104=55, srv1146040080=8, srv489892980=70, srv1700650734=44, srv934560305=95, srv819204809=90, srv608728820=74, srv474528198=69, srv1572013589=38, srv1822849539=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:33,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:33,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:33,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:33,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:33,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-14 06:53:33,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-14 06:53:33,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-14 06:53:33,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-14 06:53:33,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-14 06:53:33,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-14 06:53:33,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-14 06:53:33,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-14 06:53:33,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-14 06:53:33,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-14 06:53:33,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038380677996184664, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05761827244776886, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038380677996184664, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:33,225 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-14 06:53:33,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17635072486309955, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038380677996184664, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05761827244776886, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038380677996184664, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-14 06:53:33,525 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 2682 regions; Going from a computed imbalance of 0.17635072486309955 to a new imbalance of 0.015456787248076014. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022740861382235186); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040282392630087024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.298, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022740861382235186); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:33,538 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1812366272:80 , srv2132353990:80 , srv664003805:80 , srv1161289265:81 , srv1468841750:81 , srv1524799962:81 , srv1867845108:81 , srv474528198:81 , srv489892980:81 , srv797745113:81 , srv100160924:82 , srv235982887:82 , srv723403826:82 , srv749649752:82 , srv1079166157:83 , srv1093992961:83 , srv1596736973:83 , srv1822849539:83 , srv1983488104:83 , srv2076356314:83 , srv263702680:83 , srv34559628:83 , srv760217879:83 , srv819204809:83 , srv953308857:83 , srv1165307793:84 , srv1340137645:84 , srv1572013589:84 , srv1624150549:84 , srv1737787307:84 , srv1923572273:84 , srv440501117:84 , srv465162940:84 , srv603032703:84 , srv613103201:84 , srv699747582:84 , srv809125382:84 , srv911102041:84 , srv937456508:84 , srv1133096553:85 , srv116603381:85 , srv1176156791:85 , srv1186764313:85 , srv135669498:85 , srv1559047967:85 , srv1561223186:85 , srv1585601312:85 , srv280887136:85 , srv317581669:85 , srv331732954:85 , srv670313192:85 , srv929414151:85 , srv934560305:85 , srv1019886661:86 , srv1153707741:86 , srv1354681736:86 , srv14728130:86 , srv1518460040:86 , srv1598088188:86 , srv19535939:86 , srv2048963568:86 , srv253903595:86 , srv458343684:86 , srv873506596:86 , srv1165734929:87 , srv125698735:87 , srv1272723645:87 , srv1310538112:87 , srv1344910384:87 , srv1677934476:87 , srv1700650734:87 , srv1855351804:87 , srv699025528:87 , srv768601946:87 , srv803472365:87 , srv980666244:87 , srv1037792229:88 , srv1278044074:88 , srv1357719121:88 , srv1418221916:88 , srv1422702273:88 , srv15037375:88 , srv1896486644:88 , srv536558823:88 , srv648109339:88 , srv766862922:88 , srv1146040080:89 , srv1882297241:89 , srv963894569:89 , srv1007256502:90 , srv1088302742:90 , srv1489627430:90 , srv1759588979:90 , srv566576070:90 , srv860957418:90 , srv1307278887:91 , srv1316823714:91 , srv1525259022:91 , srv643136802:91 , srv608728820:545 }
2023-10-14 06:53:33,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:33,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1310538112=20, srv723403826=82, srv1882297241=51, srv1088302742=5, srv1340137645=22, srv1316823714=21, srv1867845108=50, srv1525259022=35, srv648109339=77, srv1161289265=10, srv699025528=80, srv331732954=64, srv768601946=86, srv1418221916=27, srv613103201=75, srv937456508=96, srv963894569=98, srv953308857=97, srv2132353990=58, srv1354681736=24, srv797745113=87, srv766862922=85, srv34559628=65, srv809125382=89, srv1165734929=12, srv664003805=78, srv860957418=91, srv1677934476=43, srv458343684=67, srv911102041=93, srv1186764313=15, srv760217879=84, srv135669498=25, srv1759588979=46, srv100160924=0, srv1079166157=4, srv1596736973=40, srv1357719121=26, srv1468841750=29, srv1855351804=49, srv19535939=54, srv980666244=99, srv1896486644=52, srv465162940=68, srv1559047967=36, srv1585601312=39, srv263702680=61, srv929414151=94, srv440501117=66, srv1737787307=45, srv1923572273=53, srv1489627430=31, srv1037792229=3, srv749649752=83, srv1344910384=23, srv1093992961=6, srv253903595=60, srv1019886661=2, srv1518460040=33, srv2076356314=57, srv125698735=16, srv1561223186=37, srv1524799962=34, srv1007256502=1, srv1812366272=47, srv1272723645=17, srv536558823=71, srv1176156791=14, srv1624150549=42, srv235982887=59, srv1133096553=7, srv1153707741=9, srv116603381=13, srv603032703=73, srv1278044074=18, srv317581669=63, srv2048963568=56, srv14728130=30, srv670313192=79, srv15037375=32, srv1598088188=41, srv643136802=76, srv803472365=88, srv1422702273=28, srv873506596=92, srv1307278887=19, srv699747582=81, srv1165307793=11, srv280887136=62, srv566576070=72, srv1983488104=55, srv1146040080=8, srv489892980=70, srv1700650734=44, srv934560305=95, srv819204809=90, srv608728820=74, srv474528198=69, srv1572013589=38, srv1822849539=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:33,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:33,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:33,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:33,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-14 06:53:33,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-14 06:53:33,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-14 06:53:33,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-14 06:53:33,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-14 06:53:33,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-14 06:53:33,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-14 06:53:33,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-14 06:53:33,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-14 06:53:33,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-14 06:53:33,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-14 06:53:33,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-14 06:53:33,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-14 06:53:33,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022740861382235186); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040282392630087024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022740861382235186); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:33,766 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-14 06:53:33,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015438007482688039, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022740861382235186); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040282392630087024, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022740861382235186); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-14 06:53:34,040 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 414 ms to try 5000 different iterations.  Found a solution that moves 989 regions; Going from a computed imbalance of 0.015438007482688039 to a new imbalance of 6.598923060410373E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0061144262001088965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01018350154434631); MoveCostFunction : (multiplier=7.0, imbalance=0.10988888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0061144262001088965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:34,041 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv809125382:79 , srv1525259022:82 , srv1759588979:82 , srv1019886661:83 , srv1088302742:83 , srv1186764313:83 , srv1357719121:83 , srv1418221916:83 , srv1489627430:83 , srv1624150549:83 , srv963894569:83 , srv1007256502:84 , srv1093992961:84 , srv1176156791:84 , srv1272723645:84 , srv1278044074:84 , srv1307278887:84 , srv1316823714:84 , srv1344910384:84 , srv1518460040:84 , srv1585601312:84 , srv1923572273:84 , srv2048963568:84 , srv34559628:84 , srv440501117:84 , srv613103201:84 , srv648109339:84 , srv699025528:84 , srv929414151:84 , srv1310538112:85 , srv1340137645:85 , srv1354681736:85 , srv14728130:85 , srv15037375:85 , srv1561223186:85 , srv1822849539:85 , srv1855351804:85 , srv1867845108:85 , srv1882297241:85 , srv263702680:85 , srv280887136:85 , srv458343684:85 , srv465162940:85 , srv860957418:85 , srv911102041:85 , srv980666244:85 , srv1037792229:86 , srv1079166157:86 , srv1146040080:86 , srv1161289265:86 , srv1165307793:86 , srv1165734929:86 , srv135669498:86 , srv1468841750:86 , srv1677934476:86 , srv2132353990:86 , srv253903595:86 , srv331732954:86 , srv536558823:86 , srv566576070:86 , srv603032703:86 , srv643136802:86 , srv670313192:86 , srv699747582:86 , srv768601946:86 , srv797745113:86 , srv873506596:86 , srv934560305:86 , srv937456508:86 , srv100160924:87 , srv116603381:87 , srv125698735:87 , srv1422702273:87 , srv1524799962:87 , srv1572013589:87 , srv1596736973:87 , srv1598088188:87 , srv1700650734:87 , srv1812366272:87 , srv1896486644:87 , srv19535939:87 , srv2076356314:87 , srv235982887:87 , srv317581669:87 , srv474528198:87 , srv489892980:87 , srv664003805:87 , srv760217879:87 , srv766862922:87 , srv803472365:87 , srv953308857:87 , srv1153707741:88 , srv1737787307:88 , srv723403826:88 , srv749649752:88 , srv1133096553:89 , srv1559047967:89 , srv1983488104:89 , srv819204809:89 , srv608728820:536 }
2023-10-14 06:53:34,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:34,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1310538112=20, srv723403826=82, srv1882297241=51, srv1088302742=5, srv1340137645=22, srv1316823714=21, srv1867845108=50, srv1525259022=35, srv648109339=77, srv1161289265=10, srv699025528=80, srv331732954=64, srv768601946=86, srv1418221916=27, srv613103201=75, srv937456508=96, srv963894569=98, srv953308857=97, srv2132353990=58, srv1354681736=24, srv797745113=87, srv766862922=85, srv34559628=65, srv809125382=89, srv1165734929=12, srv664003805=78, srv860957418=91, srv1677934476=43, srv458343684=67, srv911102041=93, srv1186764313=15, srv760217879=84, srv135669498=25, srv1759588979=46, srv100160924=0, srv1079166157=4, srv1596736973=40, srv1357719121=26, srv1468841750=29, srv1855351804=49, srv19535939=54, srv980666244=99, srv1896486644=52, srv465162940=68, srv1559047967=36, srv1585601312=39, srv263702680=61, srv929414151=94, srv440501117=66, srv1737787307=45, srv1923572273=53, srv1489627430=31, srv1037792229=3, srv749649752=83, srv1344910384=23, srv1093992961=6, srv253903595=60, srv1019886661=2, srv1518460040=33, srv2076356314=57, srv125698735=16, srv1561223186=37, srv1524799962=34, srv1007256502=1, srv1812366272=47, srv1272723645=17, srv536558823=71, srv1176156791=14, srv1624150549=42, srv235982887=59, srv1133096553=7, srv1153707741=9, srv116603381=13, srv603032703=73, srv1278044074=18, srv317581669=63, srv2048963568=56, srv14728130=30, srv670313192=79, srv15037375=32, srv1598088188=41, srv643136802=76, srv803472365=88, srv1422702273=28, srv873506596=92, srv1307278887=19, srv699747582=81, srv1165307793=11, srv280887136=62, srv566576070=72, srv1983488104=55, srv1146040080=8, srv489892980=70, srv1700650734=44, srv934560305=95, srv819204809=90, srv608728820=74, srv474528198=69, srv1572013589=38, srv1822849539=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:34,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:34,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-14 06:53:34,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-14 06:53:34,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-14 06:53:34,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-14 06:53:34,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-14 06:53:34,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-14 06:53:34,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-14 06:53:34,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-14 06:53:34,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-14 06:53:34,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-14 06:53:34,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0061144262001088965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01018350154434631); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0061144262001088965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:34,178 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-14 06:53:34,179 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.529671800273512E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0061144262001088965); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01018350154434631); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0061144262001088965); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-14 06:53:34,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 484 ms to try 5000 different iterations.  Found a solution that moves 313 regions; Going from a computed imbalance of 6.529671800273512E-4 to a new imbalance of 2.198984927914466E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.034777777777777776, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:34,566 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1422702273:82 , srv125698735:83 , srv1559047967:83 , srv1572013589:83 , srv1596736973:83 , srv1983488104:83 , srv643136802:83 , srv723403826:83 , srv760217879:83 , srv819204809:83 , srv873506596:83 , srv100160924:84 , srv1019886661:84 , srv1079166157:84 , srv1088302742:84 , srv1093992961:84 , srv1133096553:84 , srv1161289265:84 , srv1165734929:84 , srv116603381:84 , srv1316823714:84 , srv1354681736:84 , srv1418221916:84 , srv15037375:84 , srv1518460040:84 , srv1561223186:84 , srv1677934476:84 , srv1700650734:84 , srv1867845108:84 , srv2132353990:84 , srv235982887:84 , srv253903595:84 , srv280887136:84 , srv440501117:84 , srv489892980:84 , srv664003805:84 , srv749649752:84 , srv766862922:84 , srv803472365:84 , srv911102041:84 , srv929414151:84 , srv1007256502:85 , srv1037792229:85 , srv1146040080:85 , srv1153707741:85 , srv1165307793:85 , srv1176156791:85 , srv1186764313:85 , srv1272723645:85 , srv1278044074:85 , srv1307278887:85 , srv1310538112:85 , srv1340137645:85 , srv1344910384:85 , srv135669498:85 , srv1357719121:85 , srv1468841750:85 , srv14728130:85 , srv1489627430:85 , srv1524799962:85 , srv1585601312:85 , srv1598088188:85 , srv1624150549:85 , srv1737787307:85 , srv1759588979:85 , srv1812366272:85 , srv1822849539:85 , srv1855351804:85 , srv1882297241:85 , srv1896486644:85 , srv1923572273:85 , srv19535939:85 , srv2076356314:85 , srv263702680:85 , srv34559628:85 , srv465162940:85 , srv474528198:85 , srv566576070:85 , srv648109339:85 , srv670313192:85 , srv699025528:85 , srv699747582:85 , srv768601946:85 , srv797745113:85 , srv809125382:85 , srv860957418:85 , srv934560305:85 , srv937456508:85 , srv953308857:85 , srv963894569:85 , srv980666244:85 , srv1525259022:86 , srv2048963568:86 , srv317581669:86 , srv331732954:86 , srv458343684:86 , srv536558823:86 , srv603032703:86 , srv613103201:86 , srv608728820:630 }
2023-10-14 06:53:34,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:34,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1310538112=20, srv723403826=82, srv1882297241=51, srv1088302742=5, srv1340137645=22, srv1316823714=21, srv1867845108=50, srv1525259022=35, srv648109339=77, srv1161289265=10, srv699025528=80, srv331732954=64, srv768601946=86, srv1418221916=27, srv613103201=75, srv937456508=96, srv963894569=98, srv953308857=97, srv2132353990=58, srv1354681736=24, srv797745113=87, srv766862922=85, srv34559628=65, srv809125382=89, srv1165734929=12, srv664003805=78, srv860957418=91, srv1677934476=43, srv458343684=67, srv911102041=93, srv1186764313=15, srv760217879=84, srv135669498=25, srv1759588979=46, srv100160924=0, srv1079166157=4, srv1596736973=40, srv1357719121=26, srv1468841750=29, srv1855351804=49, srv19535939=54, srv980666244=99, srv1896486644=52, srv465162940=68, srv1559047967=36, srv1585601312=39, srv263702680=61, srv929414151=94, srv440501117=66, srv1737787307=45, srv1923572273=53, srv1489627430=31, srv1037792229=3, srv749649752=83, srv1344910384=23, srv1093992961=6, srv253903595=60, srv1019886661=2, srv1518460040=33, srv2076356314=57, srv125698735=16, srv1561223186=37, srv1524799962=34, srv1007256502=1, srv1812366272=47, srv1272723645=17, srv536558823=71, srv1176156791=14, srv1624150549=42, srv235982887=59, srv1133096553=7, srv1153707741=9, srv116603381=13, srv603032703=73, srv1278044074=18, srv317581669=63, srv2048963568=56, srv14728130=30, srv670313192=79, srv15037375=32, srv1598088188=41, srv643136802=76, srv803472365=88, srv1422702273=28, srv873506596=92, srv1307278887=19, srv699747582=81, srv1165307793=11, srv280887136=62, srv566576070=72, srv1983488104=55, srv1146040080=8, srv489892980=70, srv1700650734=44, srv934560305=95, srv819204809=90, srv608728820=74, srv474528198=69, srv1572013589=38, srv1822849539=48} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:34,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:34,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:34,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:34,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:34,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-14 06:53:34,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-14 06:53:34,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-14 06:53:34,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-14 06:53:34,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-14 06:53:34,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-14 06:53:34,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-14 06:53:34,696 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.9798176435581686E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:34,696 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1422702273:82 , srv125698735:83 , srv1559047967:83 , srv1572013589:83 , srv1596736973:83 , srv1983488104:83 , srv643136802:83 , srv723403826:83 , srv760217879:83 , srv819204809:83 , srv873506596:83 , srv100160924:84 , srv1019886661:84 , srv1079166157:84 , srv1088302742:84 , srv1093992961:84 , srv1133096553:84 , srv1161289265:84 , srv1165734929:84 , srv116603381:84 , srv1316823714:84 , srv1354681736:84 , srv1418221916:84 , srv15037375:84 , srv1518460040:84 , srv1561223186:84 , srv1677934476:84 , srv1700650734:84 , srv1867845108:84 , srv2132353990:84 , srv235982887:84 , srv253903595:84 , srv280887136:84 , srv440501117:84 , srv489892980:84 , srv664003805:84 , srv749649752:84 , srv766862922:84 , srv803472365:84 , srv911102041:84 , srv929414151:84 , srv1007256502:85 , srv1037792229:85 , srv1146040080:85 , srv1153707741:85 , srv1165307793:85 , srv1176156791:85 , srv1186764313:85 , srv1272723645:85 , srv1278044074:85 , srv1307278887:85 , srv1310538112:85 , srv1340137645:85 , srv1344910384:85 , srv135669498:85 , srv1357719121:85 , srv1468841750:85 , srv14728130:85 , srv1489627430:85 , srv1524799962:85 , srv1585601312:85 , srv1598088188:85 , srv1624150549:85 , srv1737787307:85 , srv1759588979:85 , srv1812366272:85 , srv1822849539:85 , srv1855351804:85 , srv1882297241:85 , srv1896486644:85 , srv1923572273:85 , srv19535939:85 , srv2076356314:85 , srv263702680:85 , srv34559628:85 , srv465162940:85 , srv474528198:85 , srv566576070:85 , srv648109339:85 , srv670313192:85 , srv699025528:85 , srv699747582:85 , srv768601946:85 , srv797745113:85 , srv809125382:85 , srv860957418:85 , srv934560305:85 , srv937456508:85 , srv953308857:85 , srv963894569:85 , srv980666244:85 , srv1525259022:86 , srv2048963568:86 , srv317581669:86 , srv331732954:86 , srv458343684:86 , srv536558823:86 , srv603032703:86 , srv613103201:86 , srv608728820:630 }
2023-10-14 06:53:34,723 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=411 (was 411), ProcessCount=171 (was 171), AvailableMemoryMB=1950 (was 2679)
2023-10-14 06:53:34,731 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=411, ProcessCount=171, AvailableMemoryMB=1952
2023-10-14 06:53:34,732 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-14 06:53:34,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-14 06:53:34,743 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007588672:84 , srv1026476988:84 , srv1036335222:84 , srv1036408012:84 , srv133841273:84 , srv1400576925:84 , srv1445486456:84 , srv145084462:84 , srv1480029865:84 , srv1516104377:84 , srv1587919503:84 , srv1701569889:84 , srv1761598467:84 , srv176832827:84 , srv1937592819:84 , srv222138736:84 , srv232316533:84 , srv345223991:84 , srv355427198:84 , srv361356994:84 , srv477916976:84 , srv533898811:84 , srv61528503:84 , srv620715573:84 , srv630094236:84 , srv819710749:84 , srv875746536:84 , srv901657901:84 , srv929721637:84 , srv1248103727:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-14 06:53:34,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:53:34,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv176832827=14, srv1400576925=6, srv620715573=24, srv145084462=8, srv222138736=16, srv1007588672=0, srv1026476988=1, srv1036335222=2, srv1445486456=7, srv61528503=23, srv819710749=26, srv1761598467=13, srv1516104377=10, srv1036408012=3, srv1248103727=4, srv133841273=5, srv929721637=29, srv345223991=18, srv361356994=20, srv901657901=28, srv875746536=27, srv1701569889=12, srv533898811=22, srv355427198=19, srv1587919503=11, srv232316533=17, srv1480029865=9, srv477916976=21, srv1937592819=15, srv630094236=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:53:34,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:53:34,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:53:34,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:53:34,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-14 06:53:34,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1034348964527185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:53:34,774 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912518963245542, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1034348964527185, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-14 06:55:34,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6122459 different iterations.  Found a solution that moves 1850 regions; Going from a computed imbalance of 0.9912518963245542 to a new imbalance of 4.317992290299789E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6851851851851852, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:55:34,770 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1007588672:90 , srv1026476988:90 , srv1036335222:90 , srv1036408012:90 , srv1248103727:90 , srv133841273:90 , srv1400576925:90 , srv1445486456:90 , srv145084462:90 , srv1480029865:90 , srv1516104377:90 , srv1587919503:90 , srv1701569889:90 , srv1761598467:90 , srv176832827:90 , srv1937592819:90 , srv222138736:90 , srv232316533:90 , srv345223991:90 , srv355427198:90 , srv361356994:90 , srv477916976:90 , srv533898811:90 , srv61528503:90 , srv620715573:90 , srv630094236:90 , srv819710749:90 , srv875746536:90 , srv901657901:90 , srv929721637:90 }
2023-10-14 06:55:34,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-14 06:55:34,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv176832827=14, srv1400576925=6, srv620715573=24, srv145084462=8, srv222138736=16, srv1007588672=0, srv1026476988=1, srv1036335222=2, srv1445486456=7, srv61528503=23, srv819710749=26, srv1761598467=13, srv1516104377=10, srv1036408012=3, srv1248103727=4, srv133841273=5, srv929721637=29, srv345223991=18, srv361356994=20, srv901657901=28, srv875746536=27, srv1701569889=12, srv533898811=22, srv355427198=19, srv1587919503=11, srv232316533=17, srv1480029865=9, srv477916976=21, srv1937592819=15, srv630094236=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-14 06:55:34,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-14 06:55:34,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-14 06:55:34,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-14 06:55:34,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-14 06:55:34,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-14 06:55:34,801 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1007588672:90 , srv1026476988:90 , srv1036335222:90 , srv1036408012:90 , srv1248103727:90 , srv133841273:90 , srv1400576925:90 , srv1445486456:90 , srv145084462:90 , srv1480029865:90 , srv1516104377:90 , srv1587919503:90 , srv1701569889:90 , srv1761598467:90 , srv176832827:90 , srv1937592819:90 , srv222138736:90 , srv232316533:90 , srv345223991:90 , srv355427198:90 , srv361356994:90 , srv477916976:90 , srv533898811:90 , srv61528503:90 , srv620715573:90 , srv630094236:90 , srv819710749:90 , srv875746536:90 , srv901657901:90 , srv929721637:90 }
2023-10-14 06:55:34,820 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 411), ProcessCount=171 (was 171), AvailableMemoryMB=2459 (was 1952) - AvailableMemoryMB LEAK? -