2023-11-23 12:53:13,982 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-23 12:53:14,312 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-23 12:53:14,441 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-23 12:53:14,516 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-23 12:53:14,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-23 12:53:14,541 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=9191
2023-11-23 12:53:14,544 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-23 12:53:14,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-23 12:53:14,684 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017781382:84 , srv1043186111:84 , srv1044709639:84 , srv1098934615:84 , srv1101020016:84 , srv1101989621:84 , srv1135161792:84 , srv1139001103:84 , srv1149097886:84 , srv1222335508:84 , srv122788893:84 , srv1235486164:84 , srv1242991500:84 , srv1244021845:84 , srv1263327775:84 , srv1267936949:84 , srv1285123492:84 , srv1299862080:84 , srv1306424579:84 , srv1342245403:84 , srv1380156217:84 , srv1387479148:84 , srv1396111154:84 , srv1476384653:84 , srv1482132989:84 , srv1502359317:84 , srv1593599567:84 , srv1664478156:84 , srv1665724048:84 , srv1674589502:84 , srv1679824193:84 , srv1683477283:84 , srv1705119155:84 , srv1727922096:84 , srv1743447100:84 , srv1770061401:84 , srv1791512164:84 , srv179433908:84 , srv1796359513:84 , srv1796898608:84 , srv1806634671:84 , srv1835811360:84 , srv1840902215:84 , srv1889062887:84 , srv189497628:84 , srv1911982401:84 , srv1946168483:84 , srv1947782554:84 , srv1956044269:84 , srv1969146182:84 , srv199253939:84 , srv2002592776:84 , srv200408968:84 , srv2015517754:84 , srv20217145:84 , srv2028500688:84 , srv2093179228:84 , srv2135444282:84 , srv2139612921:84 , srv2140927266:84 , srv217222524:84 , srv239079307:84 , srv239447317:84 , srv268839034:84 , srv287670556:84 , srv305797174:84 , srv322377158:84 , srv37785908:84 , srv378696772:84 , srv381719152:84 , srv389155359:84 , srv421955655:84 , srv430889481:84 , srv436120344:84 , srv438015747:84 , srv47181171:84 , srv520682500:84 , srv5593367:84 , srv562750603:84 , srv580127984:84 , srv582954058:84 , srv636362807:84 , srv647624999:84 , srv64987499:84 , srv64996929:84 , srv661781520:84 , srv67918453:84 , srv711894575:84 , srv722704042:84 , srv819601098:84 , srv830679506:84 , srv841558615:84 , srv870862400:84 , srv89148153:84 , srv922859721:84 , srv97148704:84 , srv989773157:84 , srv990413062:84 , srv990994926:84 , srv1818669472:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-23 12:53:14,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:14,700 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:14,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:14,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:14,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:14,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:14,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:14,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:14,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:14,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:14,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:14,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:14,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:14,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:14,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:14,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:15,050 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:15,050 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-23 12:53:15,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-23 12:53:15,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 706 ms to try 5000 different iterations.  Found a solution that moves 4711 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1827384395391165. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03971873930089329, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054581357432044314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5234444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03971873930089329, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:15,537 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1806634671:82 , srv1889062887:82 , srv381719152:82 , srv1101020016:83 , srv636362807:83 , srv830679506:83 , srv1044709639:84 , srv1285123492:84 , srv1306424579:84 , srv1796359513:84 , srv1840902215:84 , srv1911982401:84 , srv200408968:84 , srv2135444282:84 , srv305797174:84 , srv580127984:84 , srv990994926:84 , srv1017781382:85 , srv1135161792:85 , srv1139001103:85 , srv1222335508:85 , srv1235486164:85 , srv1267936949:85 , srv1380156217:85 , srv1396111154:85 , srv1679824193:85 , srv1683477283:85 , srv1743447100:85 , srv189497628:85 , srv1946168483:85 , srv1947782554:85 , srv2015517754:85 , srv239447317:85 , srv37785908:85 , srv436120344:85 , srv562750603:85 , srv647624999:85 , srv64987499:85 , srv661781520:85 , srv841558615:85 , srv922859721:85 , srv1098934615:86 , srv1149097886:86 , srv1665724048:86 , srv1674589502:86 , srv2028500688:86 , srv239079307:86 , srv322377158:86 , srv389155359:86 , srv64996929:86 , srv67918453:86 , srv1263327775:87 , srv1387479148:87 , srv1476384653:87 , srv1482132989:87 , srv1705119155:87 , srv1727922096:87 , srv1770061401:87 , srv1791512164:87 , srv1835811360:87 , srv199253939:87 , srv2002592776:87 , srv20217145:87 , srv2093179228:87 , srv2139612921:87 , srv2140927266:87 , srv217222524:87 , srv287670556:87 , srv378696772:87 , srv421955655:87 , srv47181171:87 , srv5593367:87 , srv582954058:87 , srv89148153:87 , srv1101989621:88 , srv122788893:88 , srv1242991500:88 , srv1299862080:88 , srv1664478156:88 , srv179433908:88 , srv1796898608:88 , srv268839034:88 , srv430889481:88 , srv711894575:88 , srv722704042:88 , srv819601098:88 , srv989773157:88 , srv1043186111:89 , srv1969146182:89 , srv520682500:89 , srv97148704:89 , srv990413062:89 , srv1244021845:90 , srv438015747:90 , srv870862400:90 , srv1502359317:91 , srv1593599567:91 , srv1342245403:96 , srv1956044269:100 , srv1818669472:443 }
2023-11-23 12:53:15,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:15,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:15,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:15,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:15,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:15,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:15,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:15,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:15,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:15,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:15,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:15,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:15,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:15,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:15,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:15,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03971873930089329, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054581357432044314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03971873930089329, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:15,747 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-23 12:53:15,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18270545241206848, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03971873930089329, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054581357432044314, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03971873930089329, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24208333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-23 12:53:16,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 559 ms to try 5000 different iterations.  Found a solution that moves 2677 regions; Going from a computed imbalance of 0.18270545241206848 to a new imbalance of 0.014062159154681763. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020494570862602847); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29744444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020494570862602847); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:16,179 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1956044269:72 , srv1342245403:76 , srv1502359317:80 , srv438015747:81 , srv1244021845:82 , srv1796898608:82 , srv989773157:82 , srv1593599567:83 , srv1705119155:83 , srv179433908:83 , srv2028500688:83 , srv2093179228:83 , srv421955655:83 , srv520682500:83 , srv89148153:83 , srv990413062:83 , srv1299862080:84 , srv1835811360:84 , srv1969146182:84 , srv2015517754:84 , srv287670556:84 , srv47181171:84 , srv64996929:84 , srv722704042:84 , srv819601098:84 , srv870862400:84 , srv97148704:84 , srv1043186111:85 , srv1098934615:85 , srv1101989621:85 , srv122788893:85 , srv1235486164:85 , srv1242991500:85 , srv1267936949:85 , srv1482132989:85 , srv1664478156:85 , srv1683477283:85 , srv1770061401:85 , srv1791512164:85 , srv20217145:85 , srv2139612921:85 , srv322377158:85 , srv37785908:85 , srv378696772:85 , srv430889481:85 , srv582954058:85 , srv661781520:85 , srv711894575:85 , srv1044709639:86 , srv1135161792:86 , srv1139001103:86 , srv1380156217:86 , srv1387479148:86 , srv1476384653:86 , srv1674589502:86 , srv1727922096:86 , srv189497628:86 , srv1946168483:86 , srv2135444282:86 , srv5593367:86 , srv841558615:86 , srv1149097886:87 , srv1222335508:87 , srv1263327775:87 , srv1285123492:87 , srv1665724048:87 , srv1743447100:87 , srv1840902215:87 , srv1947782554:87 , srv199253939:87 , srv2140927266:87 , srv217222524:87 , srv239079307:87 , srv239447317:87 , srv268839034:87 , srv389155359:87 , srv67918453:87 , srv1017781382:88 , srv1796359513:88 , srv1911982401:88 , srv2002592776:88 , srv200408968:88 , srv562750603:88 , srv990994926:88 , srv1306424579:89 , srv1679824193:89 , srv381719152:89 , srv436120344:89 , srv580127984:89 , srv830679506:89 , srv922859721:89 , srv1396111154:90 , srv305797174:90 , srv64987499:90 , srv1806634671:91 , srv636362807:91 , srv647624999:91 , srv1101020016:92 , srv1889062887:92 , srv1818669472:513 }
2023-11-23 12:53:16,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:16,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:16,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:16,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:16,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:16,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:16,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:16,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:16,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:16,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:16,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:16,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:16,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:16,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:16,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:16,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:16,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:16,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:16,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:16,374 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020494570862602847); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020494570862602847); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:16,375 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-23 12:53:16,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014043414400042089, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020494570862602847); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029538158470631494, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020494570862602847); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043416666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-23 12:53:16,644 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 393 ms to try 5000 different iterations.  Found a solution that moves 965 regions; Going from a computed imbalance of 0.014043414400042089 to a new imbalance of 6.212441793739974E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005427250157295044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.10722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005427250157295044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:16,647 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1101020016:82 , srv268839034:82 , srv647624999:82 , srv64987499:82 , srv1396111154:83 , srv199253939:83 , srv2002592776:83 , srv217222524:83 , srv305797174:83 , srv436120344:83 , srv1017781382:84 , srv1043186111:84 , srv1101989621:84 , srv1263327775:84 , srv1476384653:84 , srv1593599567:84 , srv1664478156:84 , srv1679824193:84 , srv1727922096:84 , srv1806634671:84 , srv1889062887:84 , srv2140927266:84 , srv239079307:84 , srv389155359:84 , srv430889481:84 , srv582954058:84 , srv636362807:84 , srv67918453:84 , srv711894575:84 , srv922859721:84 , srv1149097886:85 , srv1222335508:85 , srv122788893:85 , srv1242991500:85 , srv1299862080:85 , srv1306424579:85 , srv1342245403:85 , srv1387479148:85 , srv1665724048:85 , srv1674589502:85 , srv1743447100:85 , srv1956044269:85 , srv1969146182:85 , srv200408968:85 , srv20217145:85 , srv562750603:85 , srv580127984:85 , srv830679506:85 , srv870862400:85 , srv97148704:85 , srv1135161792:86 , srv1139001103:86 , srv1244021845:86 , srv1267936949:86 , srv1482132989:86 , srv1770061401:86 , srv1791512164:86 , srv179433908:86 , srv1796359513:86 , srv1835811360:86 , srv1840902215:86 , srv189497628:86 , srv1911982401:86 , srv1946168483:86 , srv1947782554:86 , srv2139612921:86 , srv239447317:86 , srv287670556:86 , srv322377158:86 , srv378696772:86 , srv381719152:86 , srv520682500:86 , srv5593367:86 , srv722704042:86 , srv819601098:86 , srv990994926:86 , srv1044709639:87 , srv1098934615:87 , srv1235486164:87 , srv1285123492:87 , srv1380156217:87 , srv1502359317:87 , srv1683477283:87 , srv1705119155:87 , srv1796898608:87 , srv2135444282:87 , srv438015747:87 , srv47181171:87 , srv64996929:87 , srv661781520:87 , srv841558615:87 , srv989773157:87 , srv990413062:87 , srv2028500688:88 , srv2093179228:88 , srv37785908:88 , srv421955655:88 , srv89148153:88 , srv2015517754:89 , srv1818669472:550 }
2023-11-23 12:53:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:16,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:16,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:16,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:16,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:16,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:16,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:16,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:16,681 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:16,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:16,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:16,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005427250157295044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005427250157295044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:16,847 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-23 12:53:16,847 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.1448710495215E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005427250157295044); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0073702773119008885); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005427250157295044); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-23 12:53:17,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 597 ms to try 5000 different iterations.  Found a solution that moves 231 regions; Going from a computed imbalance of 6.1448710495215E-4 to a new imbalance of 4.243238880679571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.025666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:17,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2093179228:82 , srv122788893:83 , srv378696772:83 , srv438015747:83 , srv5593367:83 , srv870862400:83 , srv990413062:83 , srv1043186111:84 , srv1098934615:84 , srv1149097886:84 , srv1244021845:84 , srv1285123492:84 , srv1306424579:84 , srv1380156217:84 , srv1387479148:84 , srv1396111154:84 , srv1502359317:84 , srv1593599567:84 , srv1665724048:84 , srv1679824193:84 , srv1791512164:84 , srv1796359513:84 , srv1889062887:84 , srv1911982401:84 , srv1947782554:84 , srv1956044269:84 , srv1969146182:84 , srv2002592776:84 , srv2015517754:84 , srv2139612921:84 , srv2140927266:84 , srv239447317:84 , srv37785908:84 , srv421955655:84 , srv47181171:84 , srv520682500:84 , srv580127984:84 , srv636362807:84 , srv647624999:84 , srv819601098:84 , srv841558615:84 , srv89148153:84 , srv922859721:84 , srv97148704:84 , srv990994926:84 , srv1017781382:85 , srv1044709639:85 , srv1101020016:85 , srv1101989621:85 , srv1135161792:85 , srv1139001103:85 , srv1222335508:85 , srv1235486164:85 , srv1242991500:85 , srv1263327775:85 , srv1299862080:85 , srv1342245403:85 , srv1476384653:85 , srv1482132989:85 , srv1664478156:85 , srv1674589502:85 , srv1683477283:85 , srv1705119155:85 , srv1727922096:85 , srv1743447100:85 , srv1770061401:85 , srv179433908:85 , srv1796898608:85 , srv1806634671:85 , srv1835811360:85 , srv1840902215:85 , srv189497628:85 , srv1946168483:85 , srv199253939:85 , srv200408968:85 , srv20217145:85 , srv2028500688:85 , srv2135444282:85 , srv217222524:85 , srv239079307:85 , srv268839034:85 , srv287670556:85 , srv305797174:85 , srv322377158:85 , srv381719152:85 , srv389155359:85 , srv430889481:85 , srv436120344:85 , srv562750603:85 , srv64987499:85 , srv64996929:85 , srv661781520:85 , srv67918453:85 , srv711894575:85 , srv722704042:85 , srv830679506:85 , srv989773157:85 , srv1267936949:86 , srv582954058:86 , srv1818669472:636 }
2023-11-23 12:53:17,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:17,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:17,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:17,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:17,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:17,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:17,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:17,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:17,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:17,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:17,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:17,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:17,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:17,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:17,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:17,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:17,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:17,481 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:17,482 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-23 12:53:17,482 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.081489223534827E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-23 12:53:17,766 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 421 ms to try 5000 different iterations.  Found a solution that moves 26 regions; Going from a computed imbalance of 4.081489223534827E-5 to a new imbalance of 6.926124944990534E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0028888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:17,767 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1242991500:83 , srv1263327775:83 , srv1482132989:83 , srv1770061401:83 , srv562750603:83 , srv722704042:83 , srv1017781382:84 , srv1043186111:84 , srv1044709639:84 , srv1098934615:84 , srv1101020016:84 , srv1101989621:84 , srv1135161792:84 , srv1139001103:84 , srv1149097886:84 , srv1222335508:84 , srv1235486164:84 , srv1244021845:84 , srv1267936949:84 , srv1285123492:84 , srv1299862080:84 , srv1306424579:84 , srv1342245403:84 , srv1380156217:84 , srv1387479148:84 , srv1396111154:84 , srv1476384653:84 , srv1502359317:84 , srv1593599567:84 , srv1664478156:84 , srv1665724048:84 , srv1674589502:84 , srv1679824193:84 , srv1683477283:84 , srv1705119155:84 , srv1727922096:84 , srv1743447100:84 , srv1791512164:84 , srv179433908:84 , srv1796359513:84 , srv1796898608:84 , srv1806634671:84 , srv1835811360:84 , srv1840902215:84 , srv1889062887:84 , srv189497628:84 , srv1911982401:84 , srv1946168483:84 , srv1947782554:84 , srv1969146182:84 , srv199253939:84 , srv2002592776:84 , srv200408968:84 , srv2015517754:84 , srv20217145:84 , srv2028500688:84 , srv2135444282:84 , srv2139612921:84 , srv2140927266:84 , srv217222524:84 , srv239079307:84 , srv239447317:84 , srv268839034:84 , srv287670556:84 , srv305797174:84 , srv322377158:84 , srv37785908:84 , srv381719152:84 , srv389155359:84 , srv421955655:84 , srv430889481:84 , srv436120344:84 , srv47181171:84 , srv520682500:84 , srv5593367:84 , srv580127984:84 , srv582954058:84 , srv636362807:84 , srv647624999:84 , srv64987499:84 , srv64996929:84 , srv661781520:84 , srv67918453:84 , srv711894575:84 , srv819601098:84 , srv830679506:84 , srv841558615:84 , srv870862400:84 , srv89148153:84 , srv922859721:84 , srv97148704:84 , srv989773157:84 , srv990413062:84 , srv990994926:84 , srv122788893:85 , srv1956044269:85 , srv378696772:85 , srv438015747:85 , srv2093179228:86 , srv1818669472:684 }
2023-11-23 12:53:17,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:17,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1476384653=23, srv520682500=77, srv389155359=71, srv1743447100=34, srv1267936949=15, srv1705119155=32, srv1222335508=9, srv20217145=55, srv722704042=89, srv1044709639=2, srv1101989621=5, srv2002592776=52, srv199253939=51, srv2093179228=57, srv1387479148=21, srv1674589502=29, srv1135161792=6, srv47181171=76, srv1818669472=41, srv64987499=84, srv1017781382=0, srv430889481=73, srv1502359317=25, srv89148153=94, srv990994926=99, srv1101020016=4, srv1139001103=7, srv239447317=63, srv239079307=62, srv819601098=90, srv2015517754=54, srv1593599567=26, srv37785908=68, srv1285123492=16, srv122788893=10, srv1770061401=35, srv1235486164=11, srv217222524=61, srv97148704=96, srv1946168483=47, srv870862400=93, srv287670556=65, srv1835811360=42, srv64996929=85, srv990413062=98, srv305797174=66, srv1796898608=39, srv1482132989=24, srv1342245403=19, srv1380156217=20, srv1969146182=50, srv421955655=72, srv636362807=82, srv1840902215=43, srv1098934615=3, srv322377158=67, srv1665724048=28, srv1889062887=44, srv1242991500=12, srv580127984=80, srv841558615=92, srv378696772=69, srv200408968=53, srv268839034=64, srv647624999=83, srv1911982401=46, srv67918453=87, srv179433908=37, srv1396111154=22, srv438015747=75, srv1956044269=49, srv2140927266=60, srv562750603=79, srv1796359513=38, srv2139612921=59, srv1806634671=40, srv711894575=88, srv1244021845=13, srv1947782554=48, srv2028500688=56, srv189497628=45, srv2135444282=58, srv661781520=86, srv1791512164=36, srv436120344=74, srv1679824193=30, srv1727922096=33, srv830679506=91, srv1149097886=8, srv1683477283=31, srv1306424579=18, srv1664478156=27, srv1299862080=17, srv582954058=81, srv989773157=97, srv1043186111=1, srv5593367=78, srv1263327775=14, srv381719152=70, srv922859721=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-23 12:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-23 12:53:17,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-23 12:53:17,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-23 12:53:17,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-23 12:53:17,939 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:17,940 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1242991500:83 , srv1263327775:83 , srv1482132989:83 , srv1770061401:83 , srv562750603:83 , srv722704042:83 , srv1017781382:84 , srv1043186111:84 , srv1044709639:84 , srv1098934615:84 , srv1101020016:84 , srv1101989621:84 , srv1135161792:84 , srv1139001103:84 , srv1149097886:84 , srv1222335508:84 , srv1235486164:84 , srv1244021845:84 , srv1267936949:84 , srv1285123492:84 , srv1299862080:84 , srv1306424579:84 , srv1342245403:84 , srv1380156217:84 , srv1387479148:84 , srv1396111154:84 , srv1476384653:84 , srv1502359317:84 , srv1593599567:84 , srv1664478156:84 , srv1665724048:84 , srv1674589502:84 , srv1679824193:84 , srv1683477283:84 , srv1705119155:84 , srv1727922096:84 , srv1743447100:84 , srv1791512164:84 , srv179433908:84 , srv1796359513:84 , srv1796898608:84 , srv1806634671:84 , srv1835811360:84 , srv1840902215:84 , srv1889062887:84 , srv189497628:84 , srv1911982401:84 , srv1946168483:84 , srv1947782554:84 , srv1969146182:84 , srv199253939:84 , srv2002592776:84 , srv200408968:84 , srv2015517754:84 , srv20217145:84 , srv2028500688:84 , srv2135444282:84 , srv2139612921:84 , srv2140927266:84 , srv217222524:84 , srv239079307:84 , srv239447317:84 , srv268839034:84 , srv287670556:84 , srv305797174:84 , srv322377158:84 , srv37785908:84 , srv381719152:84 , srv389155359:84 , srv421955655:84 , srv430889481:84 , srv436120344:84 , srv47181171:84 , srv520682500:84 , srv5593367:84 , srv580127984:84 , srv582954058:84 , srv636362807:84 , srv647624999:84 , srv64987499:84 , srv64996929:84 , srv661781520:84 , srv67918453:84 , srv711894575:84 , srv819601098:84 , srv830679506:84 , srv841558615:84 , srv870862400:84 , srv89148153:84 , srv922859721:84 , srv97148704:84 , srv989773157:84 , srv990413062:84 , srv990994926:84 , srv122788893:85 , srv1956044269:85 , srv378696772:85 , srv438015747:85 , srv2093179228:86 , srv1818669472:684 }
2023-11-23 12:53:17,968 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=8290 (was 9191)
2023-11-23 12:53:17,977 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=8290
2023-11-23 12:53:17,977 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-23 12:53:17,978 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-23 12:53:17,989 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1242330128:84 , srv1269099899:84 , srv1284759981:84 , srv1368597672:84 , srv1413609214:84 , srv143929377:84 , srv1531221251:84 , srv1562010152:84 , srv1656590160:84 , srv1747899255:84 , srv1760856758:84 , srv1809679213:84 , srv1842218873:84 , srv1902119062:84 , srv1925834946:84 , srv1982288121:84 , srv2107889754:84 , srv232055622:84 , srv376394768:84 , srv406677404:84 , srv436251171:84 , srv483032569:84 , srv503701606:84 , srv52914633:84 , srv536661761:84 , srv565527003:84 , srv650783092:84 , srv796652327:84 , srv929829669:84 , srv898559109:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-23 12:53:17,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:53:17,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1413609214=4, srv1531221251=6, srv1809679213=11, srv565527003=25, srv1842218873=12, srv796652327=27, srv1242330128=0, srv1902119062=13, srv1269099899=1, srv1760856758=10, srv436251171=20, srv1368597672=3, srv1656590160=8, srv929829669=29, srv1925834946=14, srv898559109=28, srv52914633=23, srv536661761=24, srv650783092=26, srv406677404=19, srv1562010152=7, srv376394768=18, srv503701606=22, srv483032569=21, srv2107889754=16, srv232055622=17, srv143929377=5, srv1284759981=2, srv1747899255=9, srv1982288121=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:53:18,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:53:18,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:53:18,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-23 12:53:18,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1166799759177866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:53:18,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912560698058445, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1166799759177866, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-23 12:55:18,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5972962 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.9912560698058445 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:55:18,016 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1242330128:90 , srv1269099899:90 , srv1284759981:90 , srv1368597672:90 , srv1413609214:90 , srv143929377:90 , srv1531221251:90 , srv1562010152:90 , srv1656590160:90 , srv1747899255:90 , srv1760856758:90 , srv1809679213:90 , srv1842218873:90 , srv1902119062:90 , srv1925834946:90 , srv1982288121:90 , srv2107889754:90 , srv232055622:90 , srv376394768:90 , srv406677404:90 , srv436251171:90 , srv483032569:90 , srv503701606:90 , srv52914633:90 , srv536661761:90 , srv565527003:90 , srv650783092:90 , srv796652327:90 , srv898559109:90 , srv929829669:90 }
2023-11-23 12:55:18,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-23 12:55:18,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1413609214=4, srv1531221251=6, srv1809679213=11, srv565527003=25, srv1842218873=12, srv796652327=27, srv1242330128=0, srv1902119062=13, srv1269099899=1, srv1760856758=10, srv436251171=20, srv1368597672=3, srv1656590160=8, srv929829669=29, srv1925834946=14, srv898559109=28, srv52914633=23, srv536661761=24, srv650783092=26, srv406677404=19, srv1562010152=7, srv376394768=18, srv503701606=22, srv483032569=21, srv2107889754=16, srv232055622=17, srv143929377=5, srv1284759981=2, srv1747899255=9, srv1982288121=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-23 12:55:18,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-23 12:55:18,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-23 12:55:18,034 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-23 12:55:18,034 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1242330128:90 , srv1269099899:90 , srv1284759981:90 , srv1368597672:90 , srv1413609214:90 , srv143929377:90 , srv1531221251:90 , srv1562010152:90 , srv1656590160:90 , srv1747899255:90 , srv1760856758:90 , srv1809679213:90 , srv1842218873:90 , srv1902119062:90 , srv1925834946:90 , srv1982288121:90 , srv2107889754:90 , srv232055622:90 , srv376394768:90 , srv406677404:90 , srv436251171:90 , srv483032569:90 , srv503701606:90 , srv52914633:90 , srv536661761:90 , srv565527003:90 , srv650783092:90 , srv796652327:90 , srv898559109:90 , srv929829669:90 }
2023-11-23 12:55:18,046 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=143 (was 291), ProcessCount=170 (was 170), AvailableMemoryMB=7705 (was 8290)