2024-04-19 22:53:18,267 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-19 22:53:18,598 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-19 22:53:18,710 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-19 22:53:18,775 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-19 22:53:18,782 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-19 22:53:18,801 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=171, AvailableMemoryMB=10229
2024-04-19 22:53:18,803 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-19 22:53:18,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-19 22:53:18,945 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000894022:84 , srv1016611985:84 , srv1062898662:84 , srv1067521860:84 , srv1095438612:84 , srv1101589890:84 , srv1104354453:84 , srv1180784746:84 , srv1200164774:84 , srv1213056710:84 , srv1221681759:84 , srv1235681325:84 , srv1241373799:84 , srv1242993400:84 , srv1261269534:84 , srv127389689:84 , srv1281730442:84 , srv1295172629:84 , srv1325247983:84 , srv1326908586:84 , srv1403309471:84 , srv1421317556:84 , srv1466883085:84 , srv1467311627:84 , srv147242873:84 , srv1477617963:84 , srv1539991839:84 , srv156192211:84 , srv1574168658:84 , srv1602657036:84 , srv1657966626:84 , srv1670218072:84 , srv1686634434:84 , srv1717174855:84 , srv1729729943:84 , srv1731323682:84 , srv1741228199:84 , srv1798093640:84 , srv1852828490:84 , srv190509273:84 , srv195144846:84 , srv1964367765:84 , srv1982670216:84 , srv1995678804:84 , srv2014171361:84 , srv2022819543:84 , srv2043758361:84 , srv2050908410:84 , srv2053972687:84 , srv2058987396:84 , srv2095468134:84 , srv2107554090:84 , srv2131059970:84 , srv2136108643:84 , srv231855812:84 , srv273660666:84 , srv303420878:84 , srv328389573:84 , srv349054:84 , srv356405988:84 , srv394559926:84 , srv418180463:84 , srv429495635:84 , srv430657839:84 , srv460161732:84 , srv462592232:84 , srv486249401:84 , srv490775735:84 , srv494533783:84 , srv506689756:84 , srv527668776:84 , srv529409970:84 , srv546057320:84 , srv606255263:84 , srv613195930:84 , srv627316013:84 , srv641857853:84 , srv648314217:84 , srv684674802:84 , srv72496281:84 , srv734372973:84 , srv756737225:84 , srv761483731:84 , srv768795802:84 , srv797789370:84 , srv810597308:84 , srv813953553:84 , srv824417509:84 , srv835334894:84 , srv849380042:84 , srv862607850:84 , srv862809050:84 , srv893116580:84 , srv898866549:84 , srv92590222:84 , srv937430000:84 , srv981234170:84 , srv983238399:84 , srv991242545:84 , srv899615604:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-19 22:53:18,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:18,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:19,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:19,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:19,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:19,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:19,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:19,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:19,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:19,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:19,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:19,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:19,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:19,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:19,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:19,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:19,231 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:19,232 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-19 22:53:19,232 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-19 22:53:19,587 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 504 ms to try 5000 different iterations.  Found a solution that moves 4701 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18594438599481192. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04234343755622369, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06400231477295408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5223333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04234343755622369, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18116666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:19,610 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1095438612:79 , srv756737225:79 , srv1242993400:81 , srv231855812:81 , srv981234170:81 , srv1467311627:82 , srv1602657036:83 , srv1982670216:83 , srv2043758361:83 , srv2058987396:83 , srv2095468134:83 , srv2131059970:83 , srv328389573:83 , srv494533783:83 , srv684674802:83 , srv768795802:83 , srv862607850:83 , srv862809050:83 , srv1466883085:84 , srv147242873:84 , srv156192211:84 , srv1670218072:84 , srv529409970:84 , srv648314217:84 , srv1000894022:85 , srv1016611985:85 , srv1062898662:85 , srv1101589890:85 , srv1180784746:85 , srv1281730442:85 , srv1403309471:85 , srv1574168658:85 , srv1686634434:85 , srv1741228199:85 , srv1964367765:85 , srv1995678804:85 , srv2053972687:85 , srv273660666:85 , srv394559926:85 , srv506689756:85 , srv527668776:85 , srv606255263:85 , srv761483731:85 , srv835334894:85 , srv849380042:85 , srv937430000:85 , srv991242545:85 , srv1241373799:86 , srv1325247983:86 , srv1798093640:86 , srv418180463:86 , srv430657839:86 , srv490775735:86 , srv641857853:86 , srv734372973:86 , srv797789370:86 , srv893116580:86 , srv898866549:86 , srv92590222:86 , srv1104354453:87 , srv1200164774:87 , srv1221681759:87 , srv1235681325:87 , srv127389689:87 , srv1657966626:87 , srv1717174855:87 , srv1729729943:87 , srv195144846:87 , srv2136108643:87 , srv627316013:87 , srv824417509:87 , srv1067521860:88 , srv1295172629:88 , srv190509273:88 , srv2014171361:88 , srv2022819543:88 , srv2050908410:88 , srv2107554090:88 , srv429495635:88 , srv460161732:88 , srv72496281:88 , srv813953553:88 , srv1213056710:89 , srv1421317556:89 , srv462592232:89 , srv1539991839:90 , srv1731323682:90 , srv303420878:90 , srv356405988:90 , srv546057320:90 , srv1261269534:91 , srv486249401:91 , srv613195930:91 , srv983238399:91 , srv1326908586:92 , srv1477617963:92 , srv810597308:93 , srv349054:95 , srv1852828490:99 , srv899615604:466 }
2024-04-19 22:53:19,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:19,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:19,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:19,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:19,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:19,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:19,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:19,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:19,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:19,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:19,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:19,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:19,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:19,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:19,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:19,796 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04234343755622369, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06400231477295408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04234343755622369, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18116666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:19,796 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-19 22:53:19,796 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18591146888926052, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04234343755622369, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06400231477295408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04234343755622369, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18116666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-19 22:53:20,065 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 2615 regions; Going from a computed imbalance of 0.18591146888926052 to a new imbalance of 0.016674867165153078. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024091420841750612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03954284212896644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29055555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024091420841750612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:20,086 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1852828490:72 , srv349054:77 , srv1477617963:79 , srv1539991839:80 , srv810597308:80 , srv1213056710:81 , srv1326908586:81 , srv2014171361:81 , srv1261269534:82 , srv1421317556:82 , srv1731323682:82 , srv486249401:82 , srv546057320:82 , srv627316013:82 , srv983238399:82 , srv2107554090:83 , srv2136108643:83 , srv429495635:83 , srv734372973:83 , srv1062898662:84 , srv1104354453:84 , srv1200164774:84 , srv127389689:84 , srv1325247983:84 , srv2022819543:84 , srv303420878:84 , srv356405988:84 , srv430657839:84 , srv460161732:84 , srv462592232:84 , srv527668776:84 , srv613195930:84 , srv641857853:84 , srv72496281:84 , srv824417509:84 , srv835334894:84 , srv1000894022:85 , srv1016611985:85 , srv1067521860:85 , srv1235681325:85 , srv1241373799:85 , srv1574168658:85 , srv1657966626:85 , srv1717174855:85 , srv1741228199:85 , srv1798093640:85 , srv2050908410:85 , srv273660666:85 , srv490775735:85 , srv797789370:85 , srv898866549:85 , srv1295172629:86 , srv1729729943:86 , srv190509273:86 , srv1982670216:86 , srv1995678804:86 , srv394559926:86 , srv684674802:86 , srv813953553:86 , srv92590222:86 , srv1221681759:87 , srv1281730442:87 , srv147242873:87 , srv328389573:87 , srv529409970:87 , srv648314217:87 , srv768795802:87 , srv849380042:87 , srv937430000:87 , srv1101589890:88 , srv1403309471:88 , srv1466883085:88 , srv1670218072:88 , srv1686634434:88 , srv195144846:88 , srv2058987396:88 , srv2131059970:88 , srv506689756:88 , srv761483731:88 , srv893116580:88 , srv991242545:88 , srv1180784746:89 , srv156192211:89 , srv1964367765:89 , srv2043758361:89 , srv2095468134:89 , srv418180463:89 , srv862809050:89 , srv1467311627:90 , srv2053972687:90 , srv494533783:90 , srv981234170:90 , srv1095438612:91 , srv1242993400:91 , srv606255263:91 , srv862607850:91 , srv231855812:92 , srv756737225:92 , srv1602657036:94 , srv899615604:522 }
2024-04-19 22:53:20,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:20,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:20,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:20,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:20,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:20,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:20,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:20,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:20,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:20,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:20,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:20,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:20,255 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024091420841750612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03954284212896644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024091420841750612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:20,256 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-19 22:53:20,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016656556543792323, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.024091420841750612); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03954284212896644, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.024091420841750612); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-19 22:53:20,646 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 518 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.016656556543792323 to a new imbalance of 5.296640415685196E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010024287751795105); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013665886485081019); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010024287751795105); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:20,656 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1602657036:80 , srv2053972687:81 , srv1221681759:82 , srv195144846:82 , srv1242993400:83 , srv190509273:83 , srv2050908410:83 , srv418180463:83 , srv606255263:83 , srv613195930:83 , srv813953553:83 , srv1101589890:84 , srv1180784746:84 , srv1261269534:84 , srv1295172629:84 , srv1326908586:84 , srv1403309471:84 , srv1467311627:84 , srv156192211:84 , srv1729729943:84 , srv1964367765:84 , srv231855812:84 , srv356405988:84 , srv486249401:84 , srv506689756:84 , srv862607850:84 , srv893116580:84 , srv983238399:84 , srv991242545:84 , srv1016611985:85 , srv1067521860:85 , srv1235681325:85 , srv1281730442:85 , srv1421317556:85 , srv1466883085:85 , srv1657966626:85 , srv1670218072:85 , srv1686634434:85 , srv1717174855:85 , srv1731323682:85 , srv2022819543:85 , srv2043758361:85 , srv2095468134:85 , srv303420878:85 , srv349054:85 , srv460161732:85 , srv462592232:85 , srv648314217:85 , srv72496281:85 , srv761483731:85 , srv810597308:85 , srv849380042:85 , srv898866549:85 , srv92590222:85 , srv937430000:85 , srv981234170:85 , srv1000894022:86 , srv1104354453:86 , srv1200164774:86 , srv1241373799:86 , srv127389689:86 , srv147242873:86 , srv1477617963:86 , srv1995678804:86 , srv2058987396:86 , srv2107554090:86 , srv273660666:86 , srv394559926:86 , srv429495635:86 , srv430657839:86 , srv490775735:86 , srv494533783:86 , srv546057320:86 , srv756737225:86 , srv768795802:86 , srv797789370:86 , srv824417509:86 , srv1095438612:87 , srv1213056710:87 , srv1325247983:87 , srv1539991839:87 , srv1574168658:87 , srv1741228199:87 , srv1798093640:87 , srv1852828490:87 , srv2131059970:87 , srv2136108643:87 , srv328389573:87 , srv527668776:87 , srv529409970:87 , srv627316013:87 , srv641857853:87 , srv862809050:87 , srv1062898662:88 , srv1982670216:88 , srv2014171361:88 , srv734372973:88 , srv684674802:89 , srv835334894:89 , srv899615604:559 }
2024-04-19 22:53:20,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:20,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:20,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:20,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:20,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:20,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:20,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:20,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:20,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:20,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:20,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:20,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:20,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:20,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:20,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:20,703 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:20,704 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:20,705 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:20,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:20,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:20,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:20,859 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010024287751795105); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013665886485081019); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010024287751795105); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:20,859 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-19 22:53:20,861 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.224238188201358E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010024287751795105); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013665886485081019); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010024287751795105); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-19 22:53:21,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 603 ms to try 5000 different iterations.  Found a solution that moves 304 regions; Going from a computed imbalance of 5.224238188201358E-4 to a new imbalance of 5.132325448341704E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.033777777777777775, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:21,328 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv418180463:83 , srv494533783:83 , srv606255263:83 , srv862809050:83 , srv1062898662:84 , srv1067521860:84 , srv1180784746:84 , srv1241373799:84 , srv1295172629:84 , srv1325247983:84 , srv1477617963:84 , srv1657966626:84 , srv1686634434:84 , srv1798093640:84 , srv1852828490:84 , srv1964367765:84 , srv2131059970:84 , srv303420878:84 , srv349054:84 , srv462592232:84 , srv529409970:84 , srv684674802:84 , srv734372973:84 , srv761483731:84 , srv810597308:84 , srv824417509:84 , srv835334894:84 , srv862607850:84 , srv983238399:84 , srv1095438612:85 , srv1104354453:85 , srv1200164774:85 , srv1213056710:85 , srv1235681325:85 , srv1261269534:85 , srv127389689:85 , srv1281730442:85 , srv1326908586:85 , srv1403309471:85 , srv1466883085:85 , srv147242873:85 , srv1539991839:85 , srv156192211:85 , srv1574168658:85 , srv1602657036:85 , srv1717174855:85 , srv1729729943:85 , srv1731323682:85 , srv1741228199:85 , srv1982670216:85 , srv1995678804:85 , srv2014171361:85 , srv2022819543:85 , srv2043758361:85 , srv2058987396:85 , srv2095468134:85 , srv2107554090:85 , srv2136108643:85 , srv231855812:85 , srv328389573:85 , srv356405988:85 , srv394559926:85 , srv429495635:85 , srv460161732:85 , srv490775735:85 , srv506689756:85 , srv527668776:85 , srv546057320:85 , srv613195930:85 , srv641857853:85 , srv756737225:85 , srv797789370:85 , srv813953553:85 , srv849380042:85 , srv893116580:85 , srv92590222:85 , srv937430000:85 , srv981234170:85 , srv991242545:85 , srv1000894022:86 , srv1101589890:86 , srv1221681759:86 , srv1421317556:86 , srv1467311627:86 , srv1670218072:86 , srv190509273:86 , srv195144846:86 , srv2050908410:86 , srv2053972687:86 , srv273660666:86 , srv430657839:86 , srv486249401:86 , srv627316013:86 , srv648314217:86 , srv72496281:86 , srv768795802:86 , srv898866549:86 , srv1016611985:87 , srv1242993400:87 , srv899615604:596 }
2024-04-19 22:53:21,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:21,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:21,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:21,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:21,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:21,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:21,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:21,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:21,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:21,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:21,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:21,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:21,518 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:21,519 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-19 22:53:21,522 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.919460098679358E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-19 22:53:21,812 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 439 ms to try 5000 different iterations.  Found a solution that moves 34 regions; Going from a computed imbalance of 4.919460098679358E-5 to a new imbalance of 8.21776320547874E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.003777777777777778); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:21,812 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1101589890:83 , srv1670218072:83 , srv190509273:83 , srv195144846:83 , srv303420878:83 , srv356405988:83 , srv486249401:83 , srv546057320:83 , srv613195930:83 , srv72496281:83 , srv893116580:83 , srv1000894022:84 , srv1016611985:84 , srv1067521860:84 , srv1095438612:84 , srv1104354453:84 , srv1180784746:84 , srv1200164774:84 , srv1213056710:84 , srv1221681759:84 , srv1235681325:84 , srv1242993400:84 , srv1261269534:84 , srv127389689:84 , srv1281730442:84 , srv1295172629:84 , srv1326908586:84 , srv1403309471:84 , srv1421317556:84 , srv1466883085:84 , srv1467311627:84 , srv147242873:84 , srv1539991839:84 , srv156192211:84 , srv1574168658:84 , srv1602657036:84 , srv1686634434:84 , srv1717174855:84 , srv1729729943:84 , srv1731323682:84 , srv1741228199:84 , srv1798093640:84 , srv1852828490:84 , srv1964367765:84 , srv1982670216:84 , srv1995678804:84 , srv2014171361:84 , srv2022819543:84 , srv2043758361:84 , srv2050908410:84 , srv2053972687:84 , srv2058987396:84 , srv2095468134:84 , srv2107554090:84 , srv2131059970:84 , srv2136108643:84 , srv231855812:84 , srv273660666:84 , srv328389573:84 , srv394559926:84 , srv429495635:84 , srv430657839:84 , srv460161732:84 , srv462592232:84 , srv490775735:84 , srv494533783:84 , srv506689756:84 , srv529409970:84 , srv606255263:84 , srv627316013:84 , srv641857853:84 , srv648314217:84 , srv684674802:84 , srv756737225:84 , srv761483731:84 , srv768795802:84 , srv797789370:84 , srv810597308:84 , srv813953553:84 , srv835334894:84 , srv849380042:84 , srv862607850:84 , srv862809050:84 , srv898866549:84 , srv92590222:84 , srv937430000:84 , srv991242545:84 , srv1062898662:85 , srv1241373799:85 , srv1325247983:85 , srv1477617963:85 , srv1657966626:85 , srv349054:85 , srv418180463:85 , srv527668776:85 , srv734372973:85 , srv824417509:85 , srv981234170:85 , srv983238399:85 , srv899615604:683 }
2024-04-19 22:53:21,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:21,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv72496281=79, srv1995678804=43, srv862607850=90, srv2095468134=50, srv1180784746=7, srv1281730442=16, srv768795802=83, srv328389573=57, srv1067521860=3, srv1741228199=36, srv2022819543=45, srv1964367765=41, srv1466883085=22, srv1539991839=26, srv898866549=93, srv1403309471=20, srv156192211=27, srv756737225=81, srv1852828490=38, srv127389689=15, srv1602657036=29, srv195144846=40, srv231855812=54, srv937430000=96, srv1798093640=37, srv899615604=94, srv893116580=92, srv1717174855=33, srv1241373799=12, srv1062898662=2, srv797789370=84, srv1101589890=5, srv1729729943=34, srv1731323682=35, srv1235681325=11, srv1686634434=32, srv1104354453=6, srv761483731=82, srv1574168658=28, srv1221681759=10, srv1326908586=19, srv1261269534=14, srv494533783=68, srv147242873=24, srv1657966626=30, srv613195930=74, srv546057320=72, srv627316013=75, srv506689756=69, srv734372973=80, srv1295172629=17, srv429495635=62, srv92590222=95, srv981234170=97, srv2131059970=52, srv1200164774=8, srv1421317556=21, srv2043758361=46, srv394559926=60, srv2107554090=51, srv303420878=56, srv1670218072=31, srv2058987396=49, srv606255263=73, srv462592232=65, srv1242993400=13, srv430657839=63, srv2053972687=48, srv1095438612=4, srv1213056710=9, srv273660666=55, srv2136108643=53, srv349054=58, srv1477617963=25, srv991242545=99, srv486249401=66, srv460161732=64, srv1016611985=1, srv418180463=61, srv641857853=76, srv356405988=59, srv527668776=70, srv190509273=39, srv2050908410=47, srv684674802=78, srv1000894022=0, srv810597308=85, srv849380042=89, srv835334894=88, srv813953553=86, srv1982670216=42, srv983238399=98, srv2014171361=44, srv490775735=67, srv529409970=71, srv824417509=87, srv1325247983=18, srv862809050=91, srv1467311627=23, srv648314217=77} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:21,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:21,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-19 22:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-19 22:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-19 22:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-19 22:53:21,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-19 22:53:21,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-19 22:53:21,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-19 22:53:21,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-19 22:53:21,996 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.979690117040589E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:21,996 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1101589890:83 , srv1670218072:83 , srv190509273:83 , srv195144846:83 , srv303420878:83 , srv356405988:83 , srv486249401:83 , srv546057320:83 , srv613195930:83 , srv72496281:83 , srv893116580:83 , srv1000894022:84 , srv1016611985:84 , srv1067521860:84 , srv1095438612:84 , srv1104354453:84 , srv1180784746:84 , srv1200164774:84 , srv1213056710:84 , srv1221681759:84 , srv1235681325:84 , srv1242993400:84 , srv1261269534:84 , srv127389689:84 , srv1281730442:84 , srv1295172629:84 , srv1326908586:84 , srv1403309471:84 , srv1421317556:84 , srv1466883085:84 , srv1467311627:84 , srv147242873:84 , srv1539991839:84 , srv156192211:84 , srv1574168658:84 , srv1602657036:84 , srv1686634434:84 , srv1717174855:84 , srv1729729943:84 , srv1731323682:84 , srv1741228199:84 , srv1798093640:84 , srv1852828490:84 , srv1964367765:84 , srv1982670216:84 , srv1995678804:84 , srv2014171361:84 , srv2022819543:84 , srv2043758361:84 , srv2050908410:84 , srv2053972687:84 , srv2058987396:84 , srv2095468134:84 , srv2107554090:84 , srv2131059970:84 , srv2136108643:84 , srv231855812:84 , srv273660666:84 , srv328389573:84 , srv394559926:84 , srv429495635:84 , srv430657839:84 , srv460161732:84 , srv462592232:84 , srv490775735:84 , srv494533783:84 , srv506689756:84 , srv529409970:84 , srv606255263:84 , srv627316013:84 , srv641857853:84 , srv648314217:84 , srv684674802:84 , srv756737225:84 , srv761483731:84 , srv768795802:84 , srv797789370:84 , srv810597308:84 , srv813953553:84 , srv835334894:84 , srv849380042:84 , srv862607850:84 , srv862809050:84 , srv898866549:84 , srv92590222:84 , srv937430000:84 , srv991242545:84 , srv1062898662:85 , srv1241373799:85 , srv1325247983:85 , srv1477617963:85 , srv1657966626:85 , srv349054:85 , srv418180463:85 , srv527668776:85 , srv734372973:85 , srv824417509:85 , srv981234170:85 , srv983238399:85 , srv899615604:683 }
2024-04-19 22:53:22,030 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 260) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9412 (was 10229)
2024-04-19 22:53:22,043 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=289, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=171, AvailableMemoryMB=9412
2024-04-19 22:53:22,044 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-19 22:53:22,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-19 22:53:22,052 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1046499889:84 , srv113223580:84 , srv1176139056:84 , srv1243388613:84 , srv1277654280:84 , srv1365886857:84 , srv1378973206:84 , srv1385503154:84 , srv1548963666:84 , srv1611896754:84 , srv1632982381:84 , srv1639920661:84 , srv1641770575:84 , srv1765986169:84 , srv1884645779:84 , srv1945959490:84 , srv1948208323:84 , srv2090703742:84 , srv262436131:84 , srv302512546:84 , srv373642:84 , srv418136366:84 , srv424938455:84 , srv641885687:84 , srv660441995:84 , srv667985070:84 , srv871840897:84 , srv909164080:84 , srv938372763:84 , srv1519888809:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-19 22:53:22,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:53:22,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv418136366=22, srv1243388613=3, srv424938455=23, srv1385503154=7, srv1948208323=17, srv1365886857=5, srv1639920661=12, srv641885687=24, srv1611896754=10, srv1378973206=6, srv1176139056=2, srv1548963666=9, srv660441995=25, srv1884645779=15, srv262436131=19, srv909164080=28, srv1277654280=4, srv667985070=26, srv113223580=1, srv1046499889=0, srv1632982381=11, srv1945959490=16, srv871840897=27, srv302512546=20, srv2090703742=18, srv373642=21, srv938372763=29, srv1765986169=14, srv1641770575=13, srv1519888809=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:53:22,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:53:22,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-19 22:53:22,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1611570575375936, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:53:22,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912700843890317, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1611570575375936, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-19 22:55:22,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6149063 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912700843890317 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:55:22,072 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1046499889:90 , srv113223580:90 , srv1176139056:90 , srv1243388613:90 , srv1277654280:90 , srv1365886857:90 , srv1378973206:90 , srv1385503154:90 , srv1519888809:90 , srv1548963666:90 , srv1611896754:90 , srv1632982381:90 , srv1639920661:90 , srv1641770575:90 , srv1765986169:90 , srv1884645779:90 , srv1945959490:90 , srv1948208323:90 , srv2090703742:90 , srv262436131:90 , srv302512546:90 , srv373642:90 , srv418136366:90 , srv424938455:90 , srv641885687:90 , srv660441995:90 , srv667985070:90 , srv871840897:90 , srv909164080:90 , srv938372763:90 }
2024-04-19 22:55:22,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-19 22:55:22,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv418136366=22, srv1243388613=3, srv424938455=23, srv1385503154=7, srv1948208323=17, srv1365886857=5, srv1639920661=12, srv641885687=24, srv1611896754=10, srv1378973206=6, srv1176139056=2, srv1548963666=9, srv660441995=25, srv1884645779=15, srv262436131=19, srv909164080=28, srv1277654280=4, srv667985070=26, srv113223580=1, srv1046499889=0, srv1632982381=11, srv1945959490=16, srv871840897=27, srv302512546=20, srv2090703742=18, srv373642=21, srv938372763=29, srv1765986169=14, srv1641770575=13, srv1519888809=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-19 22:55:22,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-19 22:55:22,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-19 22:55:22,089 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-19 22:55:22,089 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1046499889:90 , srv113223580:90 , srv1176139056:90 , srv1243388613:90 , srv1277654280:90 , srv1365886857:90 , srv1378973206:90 , srv1385503154:90 , srv1519888809:90 , srv1548963666:90 , srv1611896754:90 , srv1632982381:90 , srv1639920661:90 , srv1641770575:90 , srv1765986169:90 , srv1884645779:90 , srv1945959490:90 , srv1948208323:90 , srv2090703742:90 , srv262436131:90 , srv302512546:90 , srv373642:90 , srv418136366:90 , srv424938455:90 , srv641885687:90 , srv660441995:90 , srv667985070:90 , srv871840897:90 , srv909164080:90 , srv938372763:90 }
2024-04-19 22:55:22,103 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=289 (was 289), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 303), ProcessCount=167 (was 171), AvailableMemoryMB=8563 (was 9412)