2023-11-27 15:53:15,625 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-27 15:53:15,944 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-27 15:53:16,071 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-27 15:53:16,136 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-27 15:53:16,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-27 15:53:16,158 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=170, AvailableMemoryMB=9608
2023-11-27 15:53:16,160 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-27 15:53:16,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-27 15:53:16,302 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1015829584:84 , srv1015890576:84 , srv1051855921:84 , srv1052319809:84 , srv1075859530:84 , srv1100906678:84 , srv1118103115:84 , srv1122707834:84 , srv1127489481:84 , srv1129372794:84 , srv1130066997:84 , srv1130611798:84 , srv1151221948:84 , srv1156081691:84 , srv1215572642:84 , srv1229651015:84 , srv1234007712:84 , srv1242002816:84 , srv1250803996:84 , srv1276558032:84 , srv1278047219:84 , srv129616812:84 , srv1313475519:84 , srv1333844759:84 , srv133762877:84 , srv1353533335:84 , srv1388781440:84 , srv140778006:84 , srv1412914048:84 , srv1414608701:84 , srv1449231586:84 , srv145575345:84 , srv1460168389:84 , srv1464101536:84 , srv1608325120:84 , srv1617057337:84 , srv1641483107:84 , srv1662698740:84 , srv1733412858:84 , srv1786410433:84 , srv1883166281:84 , srv1903560773:84 , srv1904741041:84 , srv1908919760:84 , srv1913758331:84 , srv1953406955:84 , srv1954568424:84 , srv1962044169:84 , srv2001379539:84 , srv2001477967:84 , srv2007129497:84 , srv2028765954:84 , srv2030344130:84 , srv208073110:84 , srv2092282730:84 , srv2094792379:84 , srv2146960800:84 , srv247579008:84 , srv251037974:84 , srv260553489:84 , srv261905874:84 , srv270879733:84 , srv274593216:84 , srv275863893:84 , srv286590100:84 , srv288694343:84 , srv314079195:84 , srv31943472:84 , srv327863628:84 , srv328853143:84 , srv361279703:84 , srv373714525:84 , srv373805157:84 , srv473450601:84 , srv474808403:84 , srv514506075:84 , srv523083962:84 , srv534885004:84 , srv539211237:84 , srv543592246:84 , srv615083503:84 , srv637402946:84 , srv644608117:84 , srv6473872:84 , srv656562184:84 , srv699979058:84 , srv727327564:84 , srv729478153:84 , srv75180810:84 , srv759163642:84 , srv776084673:84 , srv799359646:84 , srv839786926:84 , srv880181498:84 , srv899919571:84 , srv909320287:84 , srv911270726:84 , srv930610441:84 , srv986708038:84 , srv721756429:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-27 15:53:16,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:16,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:16,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:16,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:16,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:16,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:16,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:16,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:16,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:16,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:16,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:16,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:16,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:16,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:16,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:16,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:16,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:16,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:16,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:16,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:16,832 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-27 15:53:16,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-27 15:53:17,581 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1136 ms to try 5000 different iterations.  Found a solution that moves 4724 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17811571828151393. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04207132347437085, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06008785188274979, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5248888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04207132347437085, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:17,593 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1129372794:82 , srv1276558032:82 , srv1662698740:82 , srv2001379539:82 , srv260553489:82 , srv759163642:82 , srv986708038:82 , srv1122707834:83 , srv1229651015:83 , srv1414608701:83 , srv1883166281:83 , srv615083503:83 , srv656562184:83 , srv1015890576:84 , srv140778006:84 , srv1903560773:84 , srv1954568424:84 , srv274593216:84 , srv473450601:84 , srv523083962:84 , srv539211237:84 , srv75180810:84 , srv1051855921:85 , srv1100906678:85 , srv1234007712:85 , srv1242002816:85 , srv1278047219:85 , srv1460168389:85 , srv1641483107:85 , srv1786410433:85 , srv1908919760:85 , srv1953406955:85 , srv2030344130:85 , srv208073110:85 , srv2146960800:85 , srv247579008:85 , srv261905874:85 , srv327863628:85 , srv361279703:85 , srv543592246:85 , srv6473872:85 , srv899919571:85 , srv911270726:85 , srv1052319809:86 , srv1127489481:86 , srv1151221948:86 , srv1313475519:86 , srv133762877:86 , srv1388781440:86 , srv1449231586:86 , srv2001477967:86 , srv2028765954:86 , srv270879733:86 , srv286590100:86 , srv314079195:86 , srv637402946:86 , srv699979058:86 , srv729478153:86 , srv1015829584:87 , srv1118103115:87 , srv1130066997:87 , srv1130611798:87 , srv1215572642:87 , srv129616812:87 , srv1353533335:87 , srv1412914048:87 , srv1733412858:87 , srv1913758331:87 , srv251037974:87 , srv373805157:87 , srv514506075:87 , srv839786926:87 , srv930610441:87 , srv1075859530:88 , srv1156081691:88 , srv1250803996:88 , srv1608325120:88 , srv1617057337:88 , srv1904741041:88 , srv2092282730:88 , srv288694343:88 , srv534885004:88 , srv776084673:88 , srv909320287:88 , srv1464101536:89 , srv2007129497:89 , srv328853143:89 , srv644608117:89 , srv880181498:89 , srv1962044169:90 , srv373714525:90 , srv727327564:90 , srv799359646:90 , srv275863893:91 , srv145575345:92 , srv31943472:92 , srv474808403:92 , srv1333844759:94 , srv2094792379:94 , srv721756429:464 }
2023-11-27 15:53:17,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:17,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:17,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:17,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:17,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:17,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:17,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:17,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:17,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:17,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04207132347437085, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06008785188274979, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04207132347437085, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:17,840 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-27 15:53:17,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17808264012652034, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04207132347437085, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06008785188274979, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04207132347437085, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.237, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-27 15:53:18,177 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 2506 regions; Going from a computed imbalance of 0.17808264012652034 to a new imbalance of 0.015233410294654935. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023745228778889783); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485741358313821, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.27844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023745228778889783); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:18,197 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1333844759:78 , srv2094792379:78 , srv31943472:79 , srv1156081691:80 , srv145575345:80 , srv727327564:80 , srv1617057337:81 , srv644608117:81 , srv776084673:81 , srv275863893:82 , srv373714525:82 , srv474808403:82 , srv1127489481:83 , srv1353533335:83 , srv1449231586:83 , srv314079195:83 , srv328853143:83 , srv880181498:83 , srv930610441:83 , srv1075859530:84 , srv1250803996:84 , srv1388781440:84 , srv1464101536:84 , srv1608325120:84 , srv1904741041:84 , srv288694343:84 , srv514506075:84 , srv534885004:84 , srv543592246:84 , srv909320287:84 , srv1118103115:85 , srv1130066997:85 , srv1151221948:85 , srv129616812:85 , srv1313475519:85 , srv133762877:85 , srv1412914048:85 , srv1641483107:85 , srv1733412858:85 , srv2007129497:85 , srv2028765954:85 , srv2092282730:85 , srv251037974:85 , srv839786926:85 , srv1015890576:86 , srv1913758331:86 , srv1962044169:86 , srv2001477967:86 , srv2030344130:86 , srv208073110:86 , srv2146960800:86 , srv373805157:86 , srv637402946:86 , srv6473872:86 , srv699979058:86 , srv799359646:86 , srv911270726:86 , srv1015829584:87 , srv1051855921:87 , srv1052319809:87 , srv1100906678:87 , srv1130611798:87 , srv1215572642:87 , srv1242002816:87 , srv1278047219:87 , srv140778006:87 , srv1786410433:87 , srv1903560773:87 , srv1908919760:87 , srv1953406955:87 , srv261905874:87 , srv270879733:87 , srv274593216:87 , srv361279703:87 , srv539211237:87 , srv729478153:87 , srv1122707834:88 , srv1129372794:88 , srv1234007712:88 , srv1662698740:88 , srv1883166281:88 , srv1954568424:88 , srv2001379539:88 , srv286590100:88 , srv473450601:88 , srv523083962:88 , srv615083503:88 , srv1229651015:89 , srv1414608701:89 , srv1460168389:89 , srv247579008:89 , srv260553489:89 , srv759163642:90 , srv899919571:90 , srv327863628:91 , srv656562184:91 , srv75180810:91 , srv986708038:91 , srv1276558032:92 , srv721756429:521 }
2023-11-27 15:53:18,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:18,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:18,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:18,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:18,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:18,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:18,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:18,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:18,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:18,342 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023745228778889783); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485741358313821, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023745228778889783); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:18,342 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-27 15:53:18,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015215862907607111, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023745228778889783); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03485741358313821, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023745228778889783); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0435, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-27 15:53:18,615 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 374 ms to try 5000 different iterations.  Found a solution that moves 960 regions; Going from a computed imbalance of 0.015215862907607111 to a new imbalance of 0.0011337460571439425. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006317058262388457); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006946969237999757); MoveCostFunction : (multiplier=7.0, imbalance=0.10666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006317058262388457); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:18,618 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv799359646:81 , srv1962044169:82 , srv327863628:82 , srv75180810:82 , srv1460168389:83 , srv275863893:83 , srv656562184:83 , srv899919571:83 , srv1015829584:84 , srv1130611798:84 , srv1215572642:84 , srv1276558032:84 , srv2007129497:84 , srv2092282730:84 , srv247579008:84 , srv270879733:84 , srv286590100:84 , srv373805157:84 , srv474808403:84 , srv986708038:84 , srv1051855921:85 , srv1052319809:85 , srv1075859530:85 , srv1100906678:85 , srv1118103115:85 , srv1130066997:85 , srv1229651015:85 , srv1234007712:85 , srv1250803996:85 , srv1278047219:85 , srv1333844759:85 , srv1412914048:85 , srv145575345:85 , srv1608325120:85 , srv1733412858:85 , srv1786410433:85 , srv1904741041:85 , srv1913758331:85 , srv1953406955:85 , srv1954568424:85 , srv2001477967:85 , srv251037974:85 , srv261905874:85 , srv361279703:85 , srv473450601:85 , srv523083962:85 , srv699979058:85 , srv729478153:85 , srv880181498:85 , srv909320287:85 , srv1122707834:86 , srv1242002816:86 , srv129616812:86 , srv1313475519:86 , srv133762877:86 , srv1414608701:86 , srv1464101536:86 , srv1883166281:86 , srv1908919760:86 , srv208073110:86 , srv2094792379:86 , srv2146960800:86 , srv274593216:86 , srv288694343:86 , srv328853143:86 , srv373714525:86 , srv514506075:86 , srv534885004:86 , srv539211237:86 , srv615083503:86 , srv637402946:86 , srv6473872:86 , srv759163642:86 , srv839786926:86 , srv1129372794:87 , srv1353533335:87 , srv1388781440:87 , srv140778006:87 , srv1641483107:87 , srv1662698740:87 , srv1903560773:87 , srv2001379539:87 , srv2028765954:87 , srv2030344130:87 , srv260553489:87 , srv31943472:87 , srv911270726:87 , srv930610441:87 , srv1015890576:88 , srv1127489481:88 , srv1151221948:88 , srv1449231586:88 , srv314079195:88 , srv543592246:88 , srv644608117:88 , srv1156081691:89 , srv1617057337:89 , srv727327564:89 , srv776084673:89 , srv721756429:529 }
2023-11-27 15:53:18,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:18,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:18,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:18,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:18,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:18,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:18,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:18,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006317058262388457); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006946969237999757); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006317058262388457); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:18,779 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-27 15:53:18,779 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.001127023993470395, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006317058262388457); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006946969237999757); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006317058262388457); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-27 15:53:19,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 476 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 0.001127023993470395 to a new imbalance of 4.295615504954411E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:19,139 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1151221948:83 , srv1464101536:83 , srv727327564:83 , srv1015829584:84 , srv1052319809:84 , srv1130611798:84 , srv1215572642:84 , srv1242002816:84 , srv1250803996:84 , srv1276558032:84 , srv129616812:84 , srv140778006:84 , srv1414608701:84 , srv145575345:84 , srv1617057337:84 , srv1903560773:84 , srv1904741041:84 , srv1908919760:84 , srv1962044169:84 , srv2007129497:84 , srv2028765954:84 , srv2030344130:84 , srv2094792379:84 , srv247579008:84 , srv260553489:84 , srv261905874:84 , srv288694343:84 , srv31943472:84 , srv327863628:84 , srv328853143:84 , srv373714525:84 , srv474808403:84 , srv534885004:84 , srv637402946:84 , srv644608117:84 , srv729478153:84 , srv759163642:84 , srv776084673:84 , srv839786926:84 , srv880181498:84 , srv899919571:84 , srv911270726:84 , srv1015890576:85 , srv1051855921:85 , srv1075859530:85 , srv1100906678:85 , srv1118103115:85 , srv1127489481:85 , srv1129372794:85 , srv1130066997:85 , srv1156081691:85 , srv1229651015:85 , srv1234007712:85 , srv1278047219:85 , srv1313475519:85 , srv1333844759:85 , srv133762877:85 , srv1353533335:85 , srv1388781440:85 , srv1412914048:85 , srv1449231586:85 , srv1460168389:85 , srv1608325120:85 , srv1641483107:85 , srv1662698740:85 , srv1733412858:85 , srv1786410433:85 , srv1883166281:85 , srv1913758331:85 , srv1953406955:85 , srv1954568424:85 , srv2001379539:85 , srv2001477967:85 , srv208073110:85 , srv2092282730:85 , srv2146960800:85 , srv251037974:85 , srv270879733:85 , srv274593216:85 , srv286590100:85 , srv314079195:85 , srv361279703:85 , srv373805157:85 , srv473450601:85 , srv514506075:85 , srv523083962:85 , srv539211237:85 , srv543592246:85 , srv615083503:85 , srv6473872:85 , srv656562184:85 , srv699979058:85 , srv75180810:85 , srv799359646:85 , srv909320287:85 , srv930610441:85 , srv986708038:85 , srv1122707834:86 , srv275863893:86 , srv721756429:628 }
2023-11-27 15:53:19,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:19,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:19,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:19,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:19,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:19,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:19,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:19,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:19,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:19,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:19,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:19,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:19,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:19,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:19,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:19,317 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:19,317 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-27 15:53:19,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.124763053251738E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-27 15:53:19,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 385 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 4.124763053251738E-5 to a new imbalance of 7.878479841169313E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:19,572 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1015890576:83 , srv1122707834:83 , srv1234007712:83 , srv1913758331:83 , srv286590100:83 , srv1015829584:84 , srv1051855921:84 , srv1052319809:84 , srv1075859530:84 , srv1100906678:84 , srv1118103115:84 , srv1127489481:84 , srv1129372794:84 , srv1130066997:84 , srv1130611798:84 , srv1151221948:84 , srv1156081691:84 , srv1215572642:84 , srv1229651015:84 , srv1242002816:84 , srv1276558032:84 , srv1278047219:84 , srv129616812:84 , srv1313475519:84 , srv1333844759:84 , srv133762877:84 , srv1353533335:84 , srv1388781440:84 , srv140778006:84 , srv1412914048:84 , srv1414608701:84 , srv1449231586:84 , srv1460168389:84 , srv1464101536:84 , srv1608325120:84 , srv1617057337:84 , srv1641483107:84 , srv1662698740:84 , srv1733412858:84 , srv1786410433:84 , srv1883166281:84 , srv1903560773:84 , srv1908919760:84 , srv1953406955:84 , srv1954568424:84 , srv1962044169:84 , srv2001379539:84 , srv2001477967:84 , srv2007129497:84 , srv2028765954:84 , srv2030344130:84 , srv208073110:84 , srv2092282730:84 , srv2094792379:84 , srv2146960800:84 , srv247579008:84 , srv251037974:84 , srv260553489:84 , srv270879733:84 , srv274593216:84 , srv275863893:84 , srv288694343:84 , srv314079195:84 , srv31943472:84 , srv327863628:84 , srv328853143:84 , srv361279703:84 , srv373714525:84 , srv373805157:84 , srv473450601:84 , srv474808403:84 , srv514506075:84 , srv523083962:84 , srv534885004:84 , srv539211237:84 , srv543592246:84 , srv615083503:84 , srv637402946:84 , srv644608117:84 , srv6473872:84 , srv656562184:84 , srv699979058:84 , srv727327564:84 , srv729478153:84 , srv75180810:84 , srv759163642:84 , srv776084673:84 , srv799359646:84 , srv839786926:84 , srv899919571:84 , srv909320287:84 , srv911270726:84 , srv930610441:84 , srv986708038:84 , srv1250803996:85 , srv145575345:85 , srv1904741041:85 , srv261905874:85 , srv880181498:85 , srv721756429:684 }
2023-11-27 15:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv656562184=84, srv140778006=27, srv274593216=62, srv2028765954=51, srv1129372794=9, srv1229651015=15, srv1641483107=36, srv1962044169=47, srv2030344130=52, srv1313475519=22, srv1388781440=26, srv1903560773=41, srv251037974=58, srv727327564=87, srv1414608701=29, srv839786926=93, srv1353533335=25, srv275863893=63, srv543592246=79, srv1953406955=45, srv288694343=65, srv133762877=24, srv1733412858=38, srv1786410433=39, srv1608325120=34, srv759163642=90, srv1883166281=40, srv1015890576=1, srv1250803996=18, srv1333844759=23, srv1464101536=33, srv31943472=67, srv1075859530=4, srv6473872=83, srv1127489481=8, srv373714525=71, srv1052319809=3, srv2092282730=54, srv1100906678=5, srv1242002816=17, srv2001477967=49, srv2146960800=56, srv644608117=82, srv986708038=99, srv1130611798=11, srv129616812=21, srv261905874=60, srv373805157=72, srv514506075=75, srv1908919760=43, srv1118103115=6, srv145575345=31, srv1449231586=30, srv1954568424=46, srv1130066997=10, srv534885004=77, srv1617057337=35, srv2001379539=48, srv2094792379=55, srv721756429=86, srv776084673=91, srv899919571=95, srv1412914048=28, srv799359646=92, srv286590100=64, srv270879733=61, srv1278047219=20, srv1662698740=37, srv637402946=81, srv314079195=66, srv328853143=69, srv327863628=68, srv1151221948=12, srv1215572642=14, srv911270726=97, srv1460168389=32, srv930610441=98, srv729478153=88, srv523083962=76, srv1051855921=2, srv1276558032=19, srv361279703=70, srv208073110=53, srv909320287=96, srv2007129497=50, srv473450601=73, srv1904741041=42, srv1122707834=7, srv474808403=74, srv539211237=78, srv260553489=59, srv699979058=85, srv1234007712=16, srv880181498=94, srv1156081691=13, srv75180810=89, srv615083503=80, srv1913758331=44, srv247579008=57, srv1015829584=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:19,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:19,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-27 15:53:19,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-27 15:53:19,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-27 15:53:19,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-27 15:53:19,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-27 15:53:19,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-27 15:53:19,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:19,731 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1015890576:83 , srv1122707834:83 , srv1234007712:83 , srv1913758331:83 , srv286590100:83 , srv1015829584:84 , srv1051855921:84 , srv1052319809:84 , srv1075859530:84 , srv1100906678:84 , srv1118103115:84 , srv1127489481:84 , srv1129372794:84 , srv1130066997:84 , srv1130611798:84 , srv1151221948:84 , srv1156081691:84 , srv1215572642:84 , srv1229651015:84 , srv1242002816:84 , srv1276558032:84 , srv1278047219:84 , srv129616812:84 , srv1313475519:84 , srv1333844759:84 , srv133762877:84 , srv1353533335:84 , srv1388781440:84 , srv140778006:84 , srv1412914048:84 , srv1414608701:84 , srv1449231586:84 , srv1460168389:84 , srv1464101536:84 , srv1608325120:84 , srv1617057337:84 , srv1641483107:84 , srv1662698740:84 , srv1733412858:84 , srv1786410433:84 , srv1883166281:84 , srv1903560773:84 , srv1908919760:84 , srv1953406955:84 , srv1954568424:84 , srv1962044169:84 , srv2001379539:84 , srv2001477967:84 , srv2007129497:84 , srv2028765954:84 , srv2030344130:84 , srv208073110:84 , srv2092282730:84 , srv2094792379:84 , srv2146960800:84 , srv247579008:84 , srv251037974:84 , srv260553489:84 , srv270879733:84 , srv274593216:84 , srv275863893:84 , srv288694343:84 , srv314079195:84 , srv31943472:84 , srv327863628:84 , srv328853143:84 , srv361279703:84 , srv373714525:84 , srv373805157:84 , srv473450601:84 , srv474808403:84 , srv514506075:84 , srv523083962:84 , srv534885004:84 , srv539211237:84 , srv543592246:84 , srv615083503:84 , srv637402946:84 , srv644608117:84 , srv6473872:84 , srv656562184:84 , srv699979058:84 , srv727327564:84 , srv729478153:84 , srv75180810:84 , srv759163642:84 , srv776084673:84 , srv799359646:84 , srv839786926:84 , srv899919571:84 , srv909320287:84 , srv911270726:84 , srv930610441:84 , srv986708038:84 , srv1250803996:85 , srv145575345:85 , srv1904741041:85 , srv261905874:85 , srv880181498:85 , srv721756429:684 }
2023-11-27 15:53:19,763 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 332) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=8677 (was 9608)
2023-11-27 15:53:19,771 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=170, AvailableMemoryMB=8677
2023-11-27 15:53:19,772 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-27 15:53:19,773 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-27 15:53:19,786 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1058804339:84 , srv1061392573:84 , srv1094761939:84 , srv1324544502:84 , srv140023501:84 , srv1456707084:84 , srv1607882031:84 , srv1615710497:84 , srv180314225:84 , srv1874726982:84 , srv1926160807:84 , srv1966609614:84 , srv2015248618:84 , srv2015990699:84 , srv267218844:84 , srv289455264:84 , srv353614613:84 , srv364791315:84 , srv515804702:84 , srv5347029:84 , srv606139022:84 , srv678158992:84 , srv688895638:84 , srv767021842:84 , srv793317652:84 , srv797934885:84 , srv882932496:84 , srv90856171:84 , srv917847719:84 , srv855154144:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-27 15:53:19,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:53:19,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv855154144=26, srv515804702=18, srv1094761939=2, srv1324544502=3, srv1061392573=1, srv2015990699=13, srv882932496=27, srv1874726982=9, srv793317652=24, srv353614613=16, srv289455264=15, srv1058804339=0, srv2015248618=12, srv917847719=29, srv606139022=20, srv767021842=23, srv797934885=25, srv180314225=8, srv267218844=14, srv678158992=21, srv1926160807=10, srv1607882031=6, srv5347029=19, srv1456707084=5, srv140023501=4, srv1615710497=7, srv1966609614=11, srv364791315=17, srv90856171=28, srv688895638=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:53:19,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:53:19,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:53:19,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-27 15:53:19,821 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1371197838797398, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:53:19,821 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912625103225912, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1371197838797398, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-27 15:55:19,807 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6494426 different iterations.  Found a solution that moves 1867 regions; Going from a computed imbalance of 0.9912625103225912 to a new imbalance of 4.3576711383728133E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6914814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:55:19,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1058804339:90 , srv1061392573:90 , srv1094761939:90 , srv1324544502:90 , srv140023501:90 , srv1456707084:90 , srv1607882031:90 , srv1615710497:90 , srv180314225:90 , srv1874726982:90 , srv1926160807:90 , srv1966609614:90 , srv2015248618:90 , srv2015990699:90 , srv267218844:90 , srv289455264:90 , srv353614613:90 , srv364791315:90 , srv515804702:90 , srv5347029:90 , srv606139022:90 , srv678158992:90 , srv688895638:90 , srv767021842:90 , srv793317652:90 , srv797934885:90 , srv855154144:90 , srv882932496:90 , srv90856171:90 , srv917847719:90 }
2023-11-27 15:55:19,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-27 15:55:19,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv855154144=26, srv515804702=18, srv1094761939=2, srv1324544502=3, srv1061392573=1, srv2015990699=13, srv882932496=27, srv1874726982=9, srv793317652=24, srv353614613=16, srv289455264=15, srv1058804339=0, srv2015248618=12, srv917847719=29, srv606139022=20, srv767021842=23, srv797934885=25, srv180314225=8, srv267218844=14, srv678158992=21, srv1926160807=10, srv1607882031=6, srv5347029=19, srv1456707084=5, srv140023501=4, srv1615710497=7, srv1966609614=11, srv364791315=17, srv90856171=28, srv688895638=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-27 15:55:19,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-27 15:55:19,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-27 15:55:19,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-27 15:55:19,838 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1058804339:90 , srv1061392573:90 , srv1094761939:90 , srv1324544502:90 , srv140023501:90 , srv1456707084:90 , srv1607882031:90 , srv1615710497:90 , srv180314225:90 , srv1874726982:90 , srv1926160807:90 , srv1966609614:90 , srv2015248618:90 , srv2015990699:90 , srv267218844:90 , srv289455264:90 , srv353614613:90 , srv364791315:90 , srv515804702:90 , srv5347029:90 , srv606139022:90 , srv678158992:90 , srv688895638:90 , srv767021842:90 , srv793317652:90 , srv797934885:90 , srv855154144:90 , srv882932496:90 , srv90856171:90 , srv917847719:90 }
2023-11-27 15:55:19,850 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 354), ProcessCount=170 (was 170), AvailableMemoryMB=8077 (was 8677)