2023-12-03 05:53:16,727 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-03 05:53:17,052 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-03 05:53:17,171 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-03 05:53:17,247 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-03 05:53:17,257 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-03 05:53:17,274 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=173, AvailableMemoryMB=4509
2023-12-03 05:53:17,276 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-03 05:53:17,277 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-03 05:53:17,394 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003614631:84 , srv1009115205:84 , srv10204994:84 , srv1033082197:84 , srv1039648975:84 , srv1050869388:84 , srv1066415294:84 , srv1067183353:84 , srv1068103284:84 , srv1082709761:84 , srv1087877287:84 , srv1091742031:84 , srv1120382047:84 , srv1202281858:84 , srv1212836726:84 , srv1214354727:84 , srv121462550:84 , srv1218828501:84 , srv1232127725:84 , srv1243856528:84 , srv1253892850:84 , srv1255287990:84 , srv1259606632:84 , srv1277078187:84 , srv1321313004:84 , srv1365592841:84 , srv1376885919:84 , srv1433326909:84 , srv1470841463:84 , srv1500572128:84 , srv1504249639:84 , srv1550618718:84 , srv1582689723:84 , srv1589378313:84 , srv1600860507:84 , srv1605658596:84 , srv1620963677:84 , srv1684586936:84 , srv1713311131:84 , srv171440369:84 , srv1717933107:84 , srv1723931571:84 , srv1740452158:84 , srv1756526646:84 , srv1768684226:84 , srv1788745159:84 , srv1789898973:84 , srv1794615175:84 , srv1821999605:84 , srv1823761886:84 , srv1852282152:84 , srv1858161352:84 , srv1905255847:84 , srv1919029016:84 , srv1921680024:84 , srv1927813736:84 , srv1935488294:84 , srv1941981055:84 , srv1952424688:84 , srv1954302925:84 , srv1970787072:84 , srv2035490241:84 , srv2108005728:84 , srv2114821181:84 , srv215647146:84 , srv221566479:84 , srv236694569:84 , srv237597176:84 , srv287737029:84 , srv303565912:84 , srv325812297:84 , srv327621188:84 , srv390769555:84 , srv401093392:84 , srv414041993:84 , srv422360403:84 , srv442038666:84 , srv493699803:84 , srv494426384:84 , srv497443269:84 , srv516885556:84 , srv525537253:84 , srv547909134:84 , srv57620108:84 , srv604865528:84 , srv668411166:84 , srv669812940:84 , srv691880805:84 , srv701752827:84 , srv712869077:84 , srv772863436:84 , srv785627489:84 , srv842413322:84 , srv860148119:84 , srv863319783:84 , srv864921492:84 , srv893690826:84 , srv915817987:84 , srv967301600:84 , srv562509942:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-03 05:53:17,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:17,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:17,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:17,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:17,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:17,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:17,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:17,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:17,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:17,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:17,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:17,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:17,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:17,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:17,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:17,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:17,677 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:17,678 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-03 05:53:17,678 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-03 05:53:18,047 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 513 ms to try 5000 different iterations.  Found a solution that moves 4660 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18124535531682615. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084712159456791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05675868939245181, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5177777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084712159456791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:18,060 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv547909134:81 , srv1259606632:82 , srv221566479:82 , srv516885556:82 , srv712869077:82 , srv1376885919:83 , srv1504249639:83 , srv1600860507:83 , srv1740452158:83 , srv1789898973:83 , srv1927813736:83 , srv1935488294:83 , srv215647146:83 , srv57620108:83 , srv785627489:83 , srv915817987:83 , srv1009115205:84 , srv1120382047:84 , srv1214354727:84 , srv121462550:84 , srv1470841463:84 , srv1921680024:84 , srv414041993:84 , srv422360403:84 , srv772863436:84 , srv863319783:84 , srv864921492:84 , srv1039648975:85 , srv1050869388:85 , srv1066415294:85 , srv1605658596:85 , srv1620963677:85 , srv1723931571:85 , srv1768684226:85 , srv1919029016:85 , srv2108005728:85 , srv236694569:85 , srv237597176:85 , srv325812297:85 , srv327621188:85 , srv669812940:85 , srv1068103284:86 , srv1087877287:86 , srv1212836726:86 , srv1232127725:86 , srv1255287990:86 , srv1550618718:86 , srv1684586936:86 , srv1717933107:86 , srv1788745159:86 , srv2035490241:86 , srv390769555:86 , srv493699803:86 , srv494426384:86 , srv842413322:86 , srv967301600:86 , srv1033082197:87 , srv1321313004:87 , srv1365592841:87 , srv1954302925:87 , srv303565912:87 , srv668411166:87 , srv860148119:87 , srv893690826:87 , srv10204994:88 , srv1218828501:88 , srv1253892850:88 , srv1500572128:88 , srv1582689723:88 , srv1589378313:88 , srv1713311131:88 , srv171440369:88 , srv1756526646:88 , srv1821999605:88 , srv1905255847:88 , srv1952424688:88 , srv1970787072:88 , srv2114821181:88 , srv1067183353:89 , srv1794615175:89 , srv1823761886:89 , srv1852282152:89 , srv287737029:89 , srv442038666:89 , srv497443269:89 , srv525537253:89 , srv691880805:89 , srv1003614631:90 , srv1091742031:90 , srv1858161352:90 , srv1941981055:90 , srv401093392:90 , srv1082709761:91 , srv1202281858:91 , srv604865528:91 , srv701752827:91 , srv1243856528:92 , srv1277078187:92 , srv1433326909:94 , srv562509942:453 }
2023-12-03 05:53:18,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:18,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:18,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:18,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:18,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:18,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:18,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:18,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:18,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:18,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:18,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:18,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:18,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:18,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:18,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:18,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:18,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084712159456791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05675868939245181, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084712159456791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:18,266 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-03 05:53:18,267 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1812127252994108, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04084712159456791, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05675868939245181, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04084712159456791, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17675, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24033333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-03 05:53:18,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 435 ms to try 5000 different iterations.  Found a solution that moves 2687 regions; Going from a computed imbalance of 0.1812127252994108 to a new imbalance of 0.015311408015464734. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02237099470665325); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03504046082032257, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2985555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02237099470665325); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:18,577 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1277078187:79 , srv604865528:79 , srv1433326909:80 , srv1243856528:81 , srv287737029:81 , srv701752827:81 , srv1003614631:82 , srv1067183353:82 , srv1082709761:82 , srv1794615175:82 , srv1821999605:82 , srv1852282152:82 , srv401093392:82 , srv525537253:82 , srv1091742031:83 , srv1202281858:83 , srv1589378313:83 , srv1713311131:83 , srv1823761886:83 , srv1858161352:83 , srv1905255847:83 , srv1952424688:83 , srv1970787072:83 , srv442038666:83 , srv497443269:83 , srv1218828501:84 , srv1941981055:84 , srv1954302925:84 , srv2114821181:84 , srv494426384:84 , srv691880805:84 , srv860148119:84 , srv10204994:85 , srv1033082197:85 , srv1050869388:85 , srv1232127725:85 , srv1253892850:85 , srv1321313004:85 , srv1500572128:85 , srv1550618718:85 , srv1582689723:85 , srv1620963677:85 , srv171440369:85 , srv236694569:85 , srv303565912:85 , srv668411166:85 , srv893690826:85 , srv967301600:85 , srv1212836726:86 , srv1255287990:86 , srv1717933107:86 , srv1723931571:86 , srv1756526646:86 , srv1919029016:86 , srv2035490241:86 , srv2108005728:86 , srv390769555:86 , srv669812940:86 , srv772863436:86 , srv1066415294:87 , srv1068103284:87 , srv1087877287:87 , srv1120382047:87 , srv1365592841:87 , srv1684586936:87 , srv1768684226:87 , srv237597176:87 , srv325812297:87 , srv327621188:87 , srv414041993:87 , srv493699803:87 , srv1214354727:88 , srv1376885919:88 , srv1470841463:88 , srv1504249639:88 , srv1605658596:88 , srv1740452158:88 , srv1788745159:88 , srv1921680024:88 , srv422360403:88 , srv712869077:88 , srv842413322:88 , srv863319783:88 , srv864921492:88 , srv1009115205:89 , srv1039648975:89 , srv1600860507:89 , srv1789898973:89 , srv1927813736:89 , srv57620108:89 , srv785627489:89 , srv915817987:89 , srv121462550:90 , srv1259606632:90 , srv547909134:90 , srv1935488294:91 , srv221566479:91 , srv215647146:92 , srv516885556:92 , srv562509942:520 }
2023-12-03 05:53:18,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:18,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:18,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:18,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:18,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:18,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:18,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:18,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:18,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:18,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:18,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:18,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:18,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:18,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:18,752 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02237099470665325); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03504046082032257, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02237099470665325); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:18,752 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-03 05:53:18,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015292593239328462, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02237099470665325); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03504046082032257, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02237099470665325); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-03 05:53:19,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 949 regions; Going from a computed imbalance of 0.015292593239328462 to a new imbalance of 7.387230650020686E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007899480725663495); MoveCostFunction : (multiplier=7.0, imbalance=0.10544444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:19,047 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv215647146:82 , srv1039648975:83 , srv1605658596:83 , srv1756526646:83 , srv1788745159:83 , srv1935488294:83 , srv1941981055:83 , srv842413322:83 , srv1082709761:84 , srv1202281858:84 , srv121462550:84 , srv1253892850:84 , srv1365592841:84 , srv1433326909:84 , srv1500572128:84 , srv171440369:84 , srv1717933107:84 , srv1858161352:84 , srv493699803:84 , srv516885556:84 , srv1003614631:85 , srv1009115205:85 , srv10204994:85 , srv1033082197:85 , srv1066415294:85 , srv1068103284:85 , srv1087877287:85 , srv1091742031:85 , srv1214354727:85 , srv1218828501:85 , srv1243856528:85 , srv1259606632:85 , srv1470841463:85 , srv1582689723:85 , srv1684586936:85 , srv1789898973:85 , srv1921680024:85 , srv2114821181:85 , srv221566479:85 , srv237597176:85 , srv303565912:85 , srv327621188:85 , srv390769555:85 , srv497443269:85 , srv57620108:85 , srv785627489:85 , srv864921492:85 , srv1120382047:86 , srv1212836726:86 , srv1255287990:86 , srv1277078187:86 , srv1321313004:86 , srv1376885919:86 , srv1589378313:86 , srv1600860507:86 , srv1723931571:86 , srv1768684226:86 , srv1794615175:86 , srv1823761886:86 , srv1905255847:86 , srv1919029016:86 , srv1927813736:86 , srv1954302925:86 , srv2035490241:86 , srv2108005728:86 , srv325812297:86 , srv401093392:86 , srv414041993:86 , srv422360403:86 , srv442038666:86 , srv525537253:86 , srv547909134:86 , srv668411166:86 , srv691880805:86 , srv701752827:86 , srv863319783:86 , srv893690826:86 , srv915817987:86 , srv967301600:86 , srv1050869388:87 , srv1067183353:87 , srv1232127725:87 , srv1504249639:87 , srv1550618718:87 , srv1620963677:87 , srv1713311131:87 , srv1740452158:87 , srv1821999605:87 , srv1852282152:87 , srv1952424688:87 , srv236694569:87 , srv494426384:87 , srv669812940:87 , srv772863436:87 , srv860148119:87 , srv1970787072:88 , srv287737029:88 , srv604865528:88 , srv712869077:88 , srv562509942:538 }
2023-12-03 05:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:19,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:19,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:19,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:19,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:19,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:19,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:19,191 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007899480725663495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:19,191 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-03 05:53:19,192 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.320780249747803E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0059824743002341195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007899480725663495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0059824743002341195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-03 05:53:19,549 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 465 ms to try 5000 different iterations.  Found a solution that moves 222 regions; Going from a computed imbalance of 7.320780249747803E-4 to a new imbalance of 3.5227001250566064E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.024666666666666667); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:19,551 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1550618718:83 , srv1713311131:83 , srv237597176:83 , srv691880805:83 , srv1009115205:84 , srv1067183353:84 , srv1068103284:84 , srv1087877287:84 , srv1091742031:84 , srv1212836726:84 , srv121462550:84 , srv1232127725:84 , srv1243856528:84 , srv1255287990:84 , srv1277078187:84 , srv1321313004:84 , srv1365592841:84 , srv1376885919:84 , srv1433326909:84 , srv1504249639:84 , srv1582689723:84 , srv1600860507:84 , srv1684586936:84 , srv1740452158:84 , srv1768684226:84 , srv1794615175:84 , srv1852282152:84 , srv1927813736:84 , srv1952424688:84 , srv1954302925:84 , srv1970787072:84 , srv2035490241:84 , srv2108005728:84 , srv221566479:84 , srv236694569:84 , srv287737029:84 , srv401093392:84 , srv422360403:84 , srv442038666:84 , srv516885556:84 , srv604865528:84 , srv669812940:84 , srv701752827:84 , srv712869077:84 , srv860148119:84 , srv863319783:84 , srv893690826:84 , srv915817987:84 , srv1003614631:85 , srv10204994:85 , srv1033082197:85 , srv1039648975:85 , srv1066415294:85 , srv1120382047:85 , srv1202281858:85 , srv1214354727:85 , srv1218828501:85 , srv1253892850:85 , srv1470841463:85 , srv1500572128:85 , srv1589378313:85 , srv1620963677:85 , srv171440369:85 , srv1723931571:85 , srv1756526646:85 , srv1788745159:85 , srv1789898973:85 , srv1821999605:85 , srv1823761886:85 , srv1858161352:85 , srv1905255847:85 , srv1919029016:85 , srv1921680024:85 , srv1935488294:85 , srv1941981055:85 , srv2114821181:85 , srv303565912:85 , srv325812297:85 , srv327621188:85 , srv390769555:85 , srv414041993:85 , srv494426384:85 , srv497443269:85 , srv525537253:85 , srv547909134:85 , srv57620108:85 , srv668411166:85 , srv772863436:85 , srv785627489:85 , srv842413322:85 , srv864921492:85 , srv967301600:85 , srv1050869388:86 , srv1082709761:86 , srv1259606632:86 , srv1605658596:86 , srv1717933107:86 , srv215647146:86 , srv493699803:86 , srv562509942:630 }
2023-12-03 05:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:19,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:19,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:19,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:19,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:19,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:19,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:19,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:19,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:19,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:19,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:19,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:19,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:19,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:19,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:19,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:19,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:19,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:19,746 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-03 05:53:19,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.367252402605814E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-03 05:53:20,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 476 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.367252402605814E-5 to a new imbalance of 8.140739559219337E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:20,086 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv10204994:83 , srv1050869388:83 , srv1082709761:83 , srv1202281858:83 , srv1259606632:83 , srv1823761886:83 , srv1970787072:83 , srv215647146:83 , srv325812297:83 , srv493699803:83 , srv668411166:83 , srv1003614631:84 , srv1009115205:84 , srv1033082197:84 , srv1039648975:84 , srv1066415294:84 , srv1067183353:84 , srv1068103284:84 , srv1087877287:84 , srv1091742031:84 , srv1120382047:84 , srv1212836726:84 , srv1214354727:84 , srv121462550:84 , srv1218828501:84 , srv1232127725:84 , srv1243856528:84 , srv1253892850:84 , srv1255287990:84 , srv1321313004:84 , srv1365592841:84 , srv1433326909:84 , srv1470841463:84 , srv1500572128:84 , srv1504249639:84 , srv1582689723:84 , srv1589378313:84 , srv1600860507:84 , srv1605658596:84 , srv1620963677:84 , srv1684586936:84 , srv171440369:84 , srv1717933107:84 , srv1723931571:84 , srv1740452158:84 , srv1756526646:84 , srv1768684226:84 , srv1788745159:84 , srv1789898973:84 , srv1821999605:84 , srv1852282152:84 , srv1858161352:84 , srv1905255847:84 , srv1919029016:84 , srv1921680024:84 , srv1927813736:84 , srv1935488294:84 , srv1941981055:84 , srv1952424688:84 , srv2035490241:84 , srv2114821181:84 , srv221566479:84 , srv287737029:84 , srv303565912:84 , srv327621188:84 , srv390769555:84 , srv401093392:84 , srv414041993:84 , srv422360403:84 , srv442038666:84 , srv494426384:84 , srv497443269:84 , srv516885556:84 , srv525537253:84 , srv547909134:84 , srv57620108:84 , srv604865528:84 , srv669812940:84 , srv691880805:84 , srv701752827:84 , srv712869077:84 , srv772863436:84 , srv785627489:84 , srv842413322:84 , srv860148119:84 , srv863319783:84 , srv864921492:84 , srv893690826:84 , srv915817987:84 , srv967301600:84 , srv1277078187:85 , srv1376885919:85 , srv1550618718:85 , srv1713311131:85 , srv1794615175:85 , srv1954302925:85 , srv2108005728:85 , srv236694569:85 , srv237597176:86 , srv562509942:685 }
2023-12-03 05:53:20,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:20,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1087877287=10, srv1550618718=31, srv1756526646=43, srv1376885919=26, srv1504249639=30, srv1009115205=1, srv494426384=78, srv842413322=93, srv1970787072=60, srv1794615175=47, srv1214354727=15, srv701752827=89, srv1589378313=33, srv669812940=87, srv772863436=91, srv1039648975=4, srv1232127725=18, srv1321313004=24, srv422360403=75, srv1905255847=52, srv497443269=79, srv1255287990=21, srv236694569=66, srv221566479=65, srv1713311131=38, srv1740452158=42, srv442038666=76, srv10204994=2, srv171440369=39, srv1935488294=56, srv1259606632=22, srv1253892850=20, srv1500572128=29, srv1033082197=3, srv2035490241=61, srv712869077=90, srv390769555=72, srv1202281858=13, srv1941981055=57, srv1066415294=6, srv1365592841=25, srv1433326909=27, srv1605658596=35, srv1218828501=17, srv414041993=74, srv1582689723=32, srv1927813736=55, srv1620963677=36, srv1684586936=37, srv1952424688=58, srv215647146=64, srv1921680024=54, srv1788745159=45, srv860148119=94, srv668411166=86, srv2114821181=63, srv303565912=69, srv237597176=67, srv604865528=85, srv1823761886=49, srv547909134=82, srv967301600=99, srv57620108=84, srv493699803=77, srv691880805=88, srv1082709761=9, srv893690826=97, srv864921492=96, srv1243856528=19, srv1821999605=48, srv785627489=92, srv1068103284=8, srv1091742031=11, srv1212836726=14, srv401093392=73, srv1858161352=51, srv1954302925=59, srv863319783=95, srv562509942=83, srv1600860507=34, srv1919029016=53, srv121462550=16, srv1789898973=46, srv287737029=68, srv525537253=81, srv1723931571=41, srv516885556=80, srv1120382047=12, srv1277078187=23, srv1717933107=40, srv1852282152=50, srv2108005728=62, srv1470841463=28, srv325812297=70, srv327621188=71, srv1768684226=44, srv1003614631=0, srv1050869388=5, srv1067183353=7, srv915817987=98} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:20,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:20,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-03 05:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-03 05:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-03 05:53:20,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-03 05:53:20,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-03 05:53:20,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-03 05:53:20,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-03 05:53:20,281 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:20,282 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv10204994:83 , srv1050869388:83 , srv1082709761:83 , srv1202281858:83 , srv1259606632:83 , srv1823761886:83 , srv1970787072:83 , srv215647146:83 , srv325812297:83 , srv493699803:83 , srv668411166:83 , srv1003614631:84 , srv1009115205:84 , srv1033082197:84 , srv1039648975:84 , srv1066415294:84 , srv1067183353:84 , srv1068103284:84 , srv1087877287:84 , srv1091742031:84 , srv1120382047:84 , srv1212836726:84 , srv1214354727:84 , srv121462550:84 , srv1218828501:84 , srv1232127725:84 , srv1243856528:84 , srv1253892850:84 , srv1255287990:84 , srv1321313004:84 , srv1365592841:84 , srv1433326909:84 , srv1470841463:84 , srv1500572128:84 , srv1504249639:84 , srv1582689723:84 , srv1589378313:84 , srv1600860507:84 , srv1605658596:84 , srv1620963677:84 , srv1684586936:84 , srv171440369:84 , srv1717933107:84 , srv1723931571:84 , srv1740452158:84 , srv1756526646:84 , srv1768684226:84 , srv1788745159:84 , srv1789898973:84 , srv1821999605:84 , srv1852282152:84 , srv1858161352:84 , srv1905255847:84 , srv1919029016:84 , srv1921680024:84 , srv1927813736:84 , srv1935488294:84 , srv1941981055:84 , srv1952424688:84 , srv2035490241:84 , srv2114821181:84 , srv221566479:84 , srv287737029:84 , srv303565912:84 , srv327621188:84 , srv390769555:84 , srv401093392:84 , srv414041993:84 , srv422360403:84 , srv442038666:84 , srv494426384:84 , srv497443269:84 , srv516885556:84 , srv525537253:84 , srv547909134:84 , srv57620108:84 , srv604865528:84 , srv669812940:84 , srv691880805:84 , srv701752827:84 , srv712869077:84 , srv772863436:84 , srv785627489:84 , srv842413322:84 , srv860148119:84 , srv863319783:84 , srv864921492:84 , srv893690826:84 , srv915817987:84 , srv967301600:84 , srv1277078187:85 , srv1376885919:85 , srv1550618718:85 , srv1713311131:85 , srv1794615175:85 , srv1954302925:85 , srv2108005728:85 , srv236694569:85 , srv237597176:86 , srv562509942:685 }
2023-12-03 05:53:20,315 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 277) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=3621 (was 4509)
2023-12-03 05:53:20,326 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=173, AvailableMemoryMB=3621
2023-12-03 05:53:20,326 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-03 05:53:20,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-03 05:53:20,338 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019183402:84 , srv1054521124:84 , srv1070412781:84 , srv1070496908:84 , srv1148342901:84 , srv1226014934:84 , srv1279005429:84 , srv1301326008:84 , srv1308777213:84 , srv1409879005:84 , srv1519428481:84 , srv1539148111:84 , srv161916005:84 , srv1735405077:84 , srv1803872077:84 , srv1815265085:84 , srv1848908543:84 , srv1969700664:84 , srv2007808761:84 , srv2010705493:84 , srv2027314367:84 , srv255191023:84 , srv367536353:84 , srv395320022:84 , srv590042100:84 , srv75243059:84 , srv89078705:84 , srv912419433:84 , srv938590829:84 , srv1873238721:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-03 05:53:20,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:53:20,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1054521124=1, srv1301326008=7, srv89078705=27, srv2027314367=21, srv2010705493=20, srv1226014934=5, srv1815265085=15, srv1803872077=14, srv161916005=12, srv1735405077=13, srv75243059=26, srv1148342901=4, srv1873238721=17, srv395320022=24, srv1308777213=8, srv2007808761=19, srv1019183402=0, srv938590829=29, srv367536353=23, srv590042100=25, srv912419433=28, srv1848908543=16, srv1539148111=11, srv1070496908=3, srv1279005429=6, srv1519428481=10, srv1969700664=18, srv1070412781=2, srv1409879005=9, srv255191023=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:53:20,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:53:20,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:53:20,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-03 05:53:20,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1432582264776803, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:53:20,380 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912644445258099, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1432582264776803, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-03 05:55:20,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6271229 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912644445258099 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:55:20,367 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1019183402:90 , srv1054521124:90 , srv1070412781:90 , srv1070496908:90 , srv1148342901:90 , srv1226014934:90 , srv1279005429:90 , srv1301326008:90 , srv1308777213:90 , srv1409879005:90 , srv1519428481:90 , srv1539148111:90 , srv161916005:90 , srv1735405077:90 , srv1803872077:90 , srv1815265085:90 , srv1848908543:90 , srv1873238721:90 , srv1969700664:90 , srv2007808761:90 , srv2010705493:90 , srv2027314367:90 , srv255191023:90 , srv367536353:90 , srv395320022:90 , srv590042100:90 , srv75243059:90 , srv89078705:90 , srv912419433:90 , srv938590829:90 }
2023-12-03 05:55:20,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-03 05:55:20,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1054521124=1, srv1301326008=7, srv89078705=27, srv2027314367=21, srv2010705493=20, srv1226014934=5, srv1815265085=15, srv1803872077=14, srv161916005=12, srv1735405077=13, srv75243059=26, srv1148342901=4, srv1873238721=17, srv395320022=24, srv1308777213=8, srv2007808761=19, srv1019183402=0, srv938590829=29, srv367536353=23, srv590042100=25, srv912419433=28, srv1848908543=16, srv1539148111=11, srv1070496908=3, srv1279005429=6, srv1519428481=10, srv1969700664=18, srv1070412781=2, srv1409879005=9, srv255191023=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-03 05:55:20,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-03 05:55:20,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-03 05:55:20,393 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-03 05:55:20,393 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1019183402:90 , srv1054521124:90 , srv1070412781:90 , srv1070496908:90 , srv1148342901:90 , srv1226014934:90 , srv1279005429:90 , srv1301326008:90 , srv1308777213:90 , srv1409879005:90 , srv1519428481:90 , srv1539148111:90 , srv161916005:90 , srv1735405077:90 , srv1803872077:90 , srv1815265085:90 , srv1848908543:90 , srv1873238721:90 , srv1969700664:90 , srv2007808761:90 , srv2010705493:90 , srv2027314367:90 , srv255191023:90 , srv367536353:90 , srv395320022:90 , srv590042100:90 , srv75243059:90 , srv89078705:90 , srv912419433:90 , srv938590829:90 }
2023-12-03 05:55:20,405 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 311), ProcessCount=169 (was 173), AvailableMemoryMB=3016 (was 3621)