2023-11-17 14:58:40,117 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-17 14:58:40,417 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-17 14:58:40,503 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-17 14:58:40,560 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 14:58:40,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-17 14:58:40,577 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=168, AvailableMemoryMB=5210
2023-11-17 14:58:40,579 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 14:58:40,580 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-17 14:58:40,686 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007832754:84 , srv1021694311:84 , srv1052855548:84 , srv1056598119:84 , srv10678024:84 , srv1080201466:84 , srv1143339008:84 , srv1145373420:84 , srv1155001407:84 , srv1190249029:84 , srv1234249936:84 , srv1240172608:84 , srv1258910876:84 , srv1271415180:84 , srv12875071:84 , srv1316260684:84 , srv1317257553:84 , srv1333647914:84 , srv1342932050:84 , srv1365157657:84 , srv1368590818:84 , srv1409458345:84 , srv142403091:84 , srv1425160811:84 , srv1454424321:84 , srv1486751292:84 , srv1493616080:84 , srv1526327898:84 , srv1531901782:84 , srv1564827866:84 , srv1626211922:84 , srv1645247855:84 , srv1658686565:84 , srv1671049522:84 , srv1685665014:84 , srv1694994339:84 , srv1697887464:84 , srv1761109181:84 , srv1775449816:84 , srv1782146124:84 , srv1821428802:84 , srv1832220025:84 , srv1852952525:84 , srv1875209732:84 , srv1902928928:84 , srv1930053253:84 , srv1953599359:84 , srv1966772831:84 , srv2000992478:84 , srv2004749770:84 , srv2006302981:84 , srv2009056525:84 , srv20137378:84 , srv2036442360:84 , srv2052077796:84 , srv2068859361:84 , srv2072643198:84 , srv2072893416:84 , srv2081433581:84 , srv2086056551:84 , srv2092712547:84 , srv2102161493:84 , srv2113778746:84 , srv2142255690:84 , srv216971936:84 , srv226869057:84 , srv242187066:84 , srv290744357:84 , srv290769091:84 , srv307648072:84 , srv313944078:84 , srv326303536:84 , srv394456513:84 , srv497824975:84 , srv521039361:84 , srv562055697:84 , srv599174907:84 , srv605089285:84 , srv606658808:84 , srv606853961:84 , srv610842254:84 , srv679997055:84 , srv716577806:84 , srv740389338:84 , srv746246278:84 , srv758408303:84 , srv785082348:84 , srv791806127:84 , srv795240696:84 , srv800484739:84 , srv803137380:84 , srv805994755:84 , srv806733370:84 , srv836056059:84 , srv848144516:84 , srv870020433:84 , srv919705473:84 , srv941286187:84 , srv953200803:84 , srv1132775313:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-17 14:58:40,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234249936=11, srv800484739=90, srv142403091=23, srv2081433581=59, srv606658808=79, srv1658686565=33, srv2004749770=50, srv1333647914=18, srv941286187=98, srv1155001407=9, srv1930053253=46, srv1671049522=34, srv1493616080=27, srv1190249029=10, srv12875071=15, srv1645247855=32, srv805994755=92, srv20137378=53, srv1240172608=12, srv1526327898=28, srv1694994339=36, srv1342932050=19, srv1143339008=7, srv1626211922=31, srv2006302981=51, srv1317257553=17, srv242187066=67, srv1782146124=40, srv2000992478=49, srv290744357=68, srv1685665014=35, srv1007832754=0, srv1852952525=43, srv226869057=66, srv1775449816=39, srv2086056551=60, srv870020433=96, srv1365157657=20, srv795240696=89, srv1832220025=42, srv2072893416=58, srv1258910876=13, srv1697887464=37, srv1080201466=5, srv610842254=81, srv2142255690=64, srv1875209732=44, srv2009056525=52, srv836056059=94, srv2036442360=54, srv1454424321=25, srv1902928928=45, srv521039361=75, srv599174907=77, srv2113778746=63, srv1425160811=24, srv1271415180=14, srv1953599359=47, srv2068859361=56, srv606853961=80, srv848144516=95, srv1966772831=48, srv758408303=86, srv307648072=70, srv1761109181=38, srv1316260684=16, srv1056598119=3, srv716577806=83, srv2102161493=62, srv605089285=78, srv1486751292=26, srv1052855548=2, srv1564827866=30, srv806733370=93, srv497824975=74, srv216971936=65, srv1132775313=6, srv791806127=88, srv1021694311=1, srv679997055=82, srv746246278=85, srv803137380=91, srv2072643198=57, srv1145373420=8, srv953200803=99, srv394456513=73, srv740389338=84, srv562055697=76, srv10678024=4, srv1821428802=41, srv290769091=69, srv785082348=87, srv2092712547=61, srv313944078=71, srv326303536=72, srv919705473=97, srv1409458345=22, srv1368590818=21, srv1531901782=29, srv2052077796=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:40,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:40,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:40,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:40,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:40,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:40,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 14:58:40,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 14:58:40,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 14:58:40,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 14:58:40,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 14:58:40,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 14:58:40,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 14:58:40,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 14:58:40,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 14:58:40,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 14:58:40,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 14:58:41,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:41,158 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 14:58:41,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 14:58:41,655 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 859 ms to try 5000 different iterations.  Found a solution that moves 4717 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1777645439898449. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040619040758352404, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05197124301967484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5241111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040619040758352404, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:41,685 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1697887464:81 , srv1316260684:82 , srv803137380:82 , srv1902928928:83 , srv2072893416:83 , srv394456513:83 , srv716577806:83 , srv785082348:83 , srv870020433:83 , srv10678024:84 , srv1240172608:84 , srv1342932050:84 , srv1526327898:84 , srv1685665014:84 , srv1782146124:84 , srv1953599359:84 , srv2006302981:84 , srv2068859361:84 , srv2081433581:84 , srv2102161493:84 , srv800484739:84 , srv836056059:84 , srv953200803:84 , srv1052855548:85 , srv1056598119:85 , srv1258910876:85 , srv1271415180:85 , srv1368590818:85 , srv142403091:85 , srv1425160811:85 , srv1486751292:85 , srv1564827866:85 , srv1645247855:85 , srv1658686565:85 , srv1671049522:85 , srv242187066:85 , srv562055697:85 , srv599174907:85 , srv679997055:85 , srv740389338:85 , srv746246278:85 , srv1007832754:86 , srv1155001407:86 , srv1190249029:86 , srv1333647914:86 , srv1454424321:86 , srv1694994339:86 , srv1821428802:86 , srv1852952525:86 , srv2004749770:86 , srv2072643198:86 , srv2142255690:86 , srv497824975:86 , srv605089285:86 , srv606658808:86 , srv795240696:86 , srv806733370:86 , srv848144516:86 , srv919705473:86 , srv941286187:86 , srv1080201466:87 , srv12875071:87 , srv1317257553:87 , srv1531901782:87 , srv1875209732:87 , srv2009056525:87 , srv2086056551:87 , srv226869057:87 , srv290769091:87 , srv326303536:87 , srv606853961:87 , srv791806127:87 , srv1021694311:88 , srv1143339008:88 , srv1145373420:88 , srv1365157657:88 , srv1930053253:88 , srv1966772831:88 , srv2000992478:88 , srv2036442360:88 , srv2052077796:88 , srv2092712547:88 , srv610842254:88 , srv1626211922:89 , srv1775449816:89 , srv216971936:89 , srv521039361:89 , srv805994755:89 , srv1832220025:90 , srv307648072:90 , srv1234249936:91 , srv1409458345:91 , srv1493616080:91 , srv1761109181:91 , srv2113778746:91 , srv290744357:91 , srv758408303:93 , srv20137378:94 , srv313944078:96 , srv1132775313:451 }
2023-11-17 14:58:41,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:41,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234249936=11, srv800484739=90, srv142403091=23, srv2081433581=59, srv606658808=79, srv1658686565=33, srv2004749770=50, srv1333647914=18, srv941286187=98, srv1155001407=9, srv1930053253=46, srv1671049522=34, srv1493616080=27, srv1190249029=10, srv12875071=15, srv1645247855=32, srv805994755=92, srv20137378=53, srv1240172608=12, srv1526327898=28, srv1694994339=36, srv1342932050=19, srv1143339008=7, srv1626211922=31, srv2006302981=51, srv1317257553=17, srv242187066=67, srv1782146124=40, srv2000992478=49, srv290744357=68, srv1685665014=35, srv1007832754=0, srv1852952525=43, srv226869057=66, srv1775449816=39, srv2086056551=60, srv870020433=96, srv1365157657=20, srv795240696=89, srv1832220025=42, srv2072893416=58, srv1258910876=13, srv1697887464=37, srv1080201466=5, srv610842254=81, srv2142255690=64, srv1875209732=44, srv2009056525=52, srv836056059=94, srv2036442360=54, srv1454424321=25, srv1902928928=45, srv521039361=75, srv599174907=77, srv2113778746=63, srv1425160811=24, srv1271415180=14, srv1953599359=47, srv2068859361=56, srv606853961=80, srv848144516=95, srv1966772831=48, srv758408303=86, srv307648072=70, srv1761109181=38, srv1316260684=16, srv1056598119=3, srv716577806=83, srv2102161493=62, srv605089285=78, srv1486751292=26, srv1052855548=2, srv1564827866=30, srv806733370=93, srv497824975=74, srv216971936=65, srv1132775313=6, srv791806127=88, srv1021694311=1, srv679997055=82, srv746246278=85, srv803137380=91, srv2072643198=57, srv1145373420=8, srv953200803=99, srv394456513=73, srv740389338=84, srv562055697=76, srv10678024=4, srv1821428802=41, srv290769091=69, srv785082348=87, srv2092712547=61, srv313944078=71, srv326303536=72, srv919705473=97, srv1409458345=22, srv1368590818=21, srv1531901782=29, srv2052077796=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:41,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:41,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:41,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 14:58:41,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 14:58:41,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 14:58:41,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 14:58:41,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 14:58:41,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 14:58:41,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 14:58:41,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 14:58:41,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 14:58:41,842 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040619040758352404, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05197124301967484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040619040758352404, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:41,842 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 14:58:41,842 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17773151484989894, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040619040758352404, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05197124301967484, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040619040758352404, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23525, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 14:58:42,075 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 337 ms to try 5000 different iterations.  Found a solution that moves 2548 regions; Going from a computed imbalance of 0.17773151484989894 to a new imbalance of 0.014571609190418899. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02081036893699094); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03257728443685049, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2831111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02081036893699094); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,084 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv313944078:76 , srv20137378:80 , srv758408303:80 , srv1493616080:81 , srv1761109181:81 , srv2113778746:81 , srv290744357:81 , srv1143339008:82 , srv1234249936:82 , srv1409458345:82 , srv1626211922:82 , srv307648072:82 , srv805994755:82 , srv1145373420:83 , srv1365157657:83 , srv2052077796:83 , srv2086056551:83 , srv216971936:83 , srv606853961:83 , srv610842254:83 , srv1021694311:84 , srv1454424321:84 , srv1531901782:84 , srv1775449816:84 , srv2036442360:84 , srv2092712547:84 , srv226869057:84 , srv521039361:84 , srv12875071:85 , srv1333647914:85 , srv1832220025:85 , srv1875209732:85 , srv1930053253:85 , srv2000992478:85 , srv2004749770:85 , srv326303536:85 , srv679997055:85 , srv791806127:85 , srv806733370:85 , srv941286187:85 , srv1007832754:86 , srv1052855548:86 , srv1080201466:86 , srv1190249029:86 , srv1271415180:86 , srv1317257553:86 , srv1368590818:86 , srv1425160811:86 , srv1564827866:86 , srv1645247855:86 , srv1685665014:86 , srv1694994339:86 , srv1821428802:86 , srv1852952525:86 , srv290769091:86 , srv562055697:86 , srv746246278:86 , srv848144516:86 , srv1155001407:87 , srv1240172608:87 , srv142403091:87 , srv1486751292:87 , srv1526327898:87 , srv1671049522:87 , srv2009056525:87 , srv2072643198:87 , srv599174907:87 , srv740389338:87 , srv800484739:87 , srv836056059:87 , srv919705473:87 , srv10678024:88 , srv1258910876:88 , srv1342932050:88 , srv1782146124:88 , srv1902928928:88 , srv1953599359:88 , srv1966772831:88 , srv2068859361:88 , srv2102161493:88 , srv2142255690:88 , srv497824975:88 , srv606658808:88 , srv795240696:88 , srv803137380:88 , srv1056598119:89 , srv2006302981:89 , srv2081433581:89 , srv242187066:89 , srv605089285:89 , srv716577806:89 , srv953200803:89 , srv1316260684:90 , srv1658686565:90 , srv1697887464:90 , srv785082348:90 , srv2072893416:91 , srv394456513:91 , srv870020433:91 , srv1132775313:508 }
2023-11-17 14:58:42,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:42,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234249936=11, srv800484739=90, srv142403091=23, srv2081433581=59, srv606658808=79, srv1658686565=33, srv2004749770=50, srv1333647914=18, srv941286187=98, srv1155001407=9, srv1930053253=46, srv1671049522=34, srv1493616080=27, srv1190249029=10, srv12875071=15, srv1645247855=32, srv805994755=92, srv20137378=53, srv1240172608=12, srv1526327898=28, srv1694994339=36, srv1342932050=19, srv1143339008=7, srv1626211922=31, srv2006302981=51, srv1317257553=17, srv242187066=67, srv1782146124=40, srv2000992478=49, srv290744357=68, srv1685665014=35, srv1007832754=0, srv1852952525=43, srv226869057=66, srv1775449816=39, srv2086056551=60, srv870020433=96, srv1365157657=20, srv795240696=89, srv1832220025=42, srv2072893416=58, srv1258910876=13, srv1697887464=37, srv1080201466=5, srv610842254=81, srv2142255690=64, srv1875209732=44, srv2009056525=52, srv836056059=94, srv2036442360=54, srv1454424321=25, srv1902928928=45, srv521039361=75, srv599174907=77, srv2113778746=63, srv1425160811=24, srv1271415180=14, srv1953599359=47, srv2068859361=56, srv606853961=80, srv848144516=95, srv1966772831=48, srv758408303=86, srv307648072=70, srv1761109181=38, srv1316260684=16, srv1056598119=3, srv716577806=83, srv2102161493=62, srv605089285=78, srv1486751292=26, srv1052855548=2, srv1564827866=30, srv806733370=93, srv497824975=74, srv216971936=65, srv1132775313=6, srv791806127=88, srv1021694311=1, srv679997055=82, srv746246278=85, srv803137380=91, srv2072643198=57, srv1145373420=8, srv953200803=99, srv394456513=73, srv740389338=84, srv562055697=76, srv10678024=4, srv1821428802=41, srv290769091=69, srv785082348=87, srv2092712547=61, srv313944078=71, srv326303536=72, srv919705473=97, srv1409458345=22, srv1368590818=21, srv1531901782=29, srv2052077796=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:42,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:42,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 14:58:42,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 14:58:42,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 14:58:42,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 14:58:42,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 14:58:42,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 14:58:42,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 14:58:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 14:58:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 14:58:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 14:58:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 14:58:42,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02081036893699094); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03257728443685049, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02081036893699094); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,217 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 14:58:42,217 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014553767713085357, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02081036893699094); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03257728443685049, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02081036893699094); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011666666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 14:58:42,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 270 ms to try 5000 different iterations.  Found a solution that moves 991 regions; Going from a computed imbalance of 0.014553767713085357 to a new imbalance of 4.935133382914598E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004001496166126755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.11011111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004001496166126755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,404 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1966772831:80 , srv1658686565:82 , srv20137378:83 , srv2072893416:83 , srv497824975:83 , srv919705473:83 , srv1056598119:84 , srv1155001407:84 , srv1234249936:84 , srv1317257553:84 , srv1409458345:84 , srv1832220025:84 , srv1930053253:84 , srv2009056525:84 , srv2142255690:84 , srv242187066:84 , srv290769091:84 , srv394456513:84 , srv521039361:84 , srv605089285:84 , srv870020433:84 , srv1007832754:85 , srv1080201466:85 , srv1258910876:85 , srv1316260684:85 , srv1342932050:85 , srv142403091:85 , srv1486751292:85 , srv1671049522:85 , srv1761109181:85 , srv1775449816:85 , srv1821428802:85 , srv1875209732:85 , srv2000992478:85 , srv2006302981:85 , srv2068859361:85 , srv2072643198:85 , srv2081433581:85 , srv2092712547:85 , srv2102161493:85 , srv785082348:85 , srv795240696:85 , srv953200803:85 , srv1021694311:86 , srv10678024:86 , srv1190249029:86 , srv12875071:86 , srv1368590818:86 , srv1425160811:86 , srv1493616080:86 , srv1526327898:86 , srv1531901782:86 , srv1626211922:86 , srv1694994339:86 , srv1697887464:86 , srv1852952525:86 , srv1902928928:86 , srv2004749770:86 , srv2036442360:86 , srv2113778746:86 , srv216971936:86 , srv290744357:86 , srv307648072:86 , srv313944078:86 , srv326303536:86 , srv599174907:86 , srv606658808:86 , srv610842254:86 , srv716577806:86 , srv740389338:86 , srv758408303:86 , srv791806127:86 , srv800484739:86 , srv806733370:86 , srv836056059:86 , srv848144516:86 , srv941286187:86 , srv1143339008:87 , srv1145373420:87 , srv1240172608:87 , srv1271415180:87 , srv1333647914:87 , srv1365157657:87 , srv1454424321:87 , srv1564827866:87 , srv1645247855:87 , srv1782146124:87 , srv1953599359:87 , srv2052077796:87 , srv226869057:87 , srv562055697:87 , srv606853961:87 , srv679997055:87 , srv746246278:87 , srv805994755:87 , srv1052855548:88 , srv1685665014:88 , srv2086056551:88 , srv803137380:88 , srv1132775313:534 }
2023-11-17 14:58:42,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:42,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234249936=11, srv800484739=90, srv142403091=23, srv2081433581=59, srv606658808=79, srv1658686565=33, srv2004749770=50, srv1333647914=18, srv941286187=98, srv1155001407=9, srv1930053253=46, srv1671049522=34, srv1493616080=27, srv1190249029=10, srv12875071=15, srv1645247855=32, srv805994755=92, srv20137378=53, srv1240172608=12, srv1526327898=28, srv1694994339=36, srv1342932050=19, srv1143339008=7, srv1626211922=31, srv2006302981=51, srv1317257553=17, srv242187066=67, srv1782146124=40, srv2000992478=49, srv290744357=68, srv1685665014=35, srv1007832754=0, srv1852952525=43, srv226869057=66, srv1775449816=39, srv2086056551=60, srv870020433=96, srv1365157657=20, srv795240696=89, srv1832220025=42, srv2072893416=58, srv1258910876=13, srv1697887464=37, srv1080201466=5, srv610842254=81, srv2142255690=64, srv1875209732=44, srv2009056525=52, srv836056059=94, srv2036442360=54, srv1454424321=25, srv1902928928=45, srv521039361=75, srv599174907=77, srv2113778746=63, srv1425160811=24, srv1271415180=14, srv1953599359=47, srv2068859361=56, srv606853961=80, srv848144516=95, srv1966772831=48, srv758408303=86, srv307648072=70, srv1761109181=38, srv1316260684=16, srv1056598119=3, srv716577806=83, srv2102161493=62, srv605089285=78, srv1486751292=26, srv1052855548=2, srv1564827866=30, srv806733370=93, srv497824975=74, srv216971936=65, srv1132775313=6, srv791806127=88, srv1021694311=1, srv679997055=82, srv746246278=85, srv803137380=91, srv2072643198=57, srv1145373420=8, srv953200803=99, srv394456513=73, srv740389338=84, srv562055697=76, srv10678024=4, srv1821428802=41, srv290769091=69, srv785082348=87, srv2092712547=61, srv313944078=71, srv326303536=72, srv919705473=97, srv1409458345=22, srv1368590818=21, srv1531901782=29, srv2052077796=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:42,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:42,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:42,423 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:42,424 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:42,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 14:58:42,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 14:58:42,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 14:58:42,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 14:58:42,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 14:58:42,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 14:58:42,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 14:58:42,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 14:58:42,547 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004001496166126755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004001496166126755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,547 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-17 14:58:42,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.865742079784538E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004001496166126755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008812805701489793); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004001496166126755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-17 14:58:42,828 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 226 regions; Going from a computed imbalance of 4.865742079784538E-4 to a new imbalance of 1.2388165230157683E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.025111111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,829 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv606658808:82 , srv1052855548:83 , srv1190249029:83 , srv1564827866:83 , srv1782146124:83 , srv1832220025:83 , srv1953599359:83 , srv2036442360:83 , srv226869057:83 , srv605089285:83 , srv758408303:83 , srv795240696:83 , srv1021694311:84 , srv1056598119:84 , srv10678024:84 , srv1080201466:84 , srv1240172608:84 , srv1258910876:84 , srv1271415180:84 , srv12875071:84 , srv1333647914:84 , srv1365157657:84 , srv1425160811:84 , srv1493616080:84 , srv1645247855:84 , srv1685665014:84 , srv1694994339:84 , srv1761109181:84 , srv1775449816:84 , srv1852952525:84 , srv2000992478:84 , srv2006302981:84 , srv2009056525:84 , srv2052077796:84 , srv2072643198:84 , srv2081433581:84 , srv2086056551:84 , srv2113778746:84 , srv2142255690:84 , srv216971936:84 , srv242187066:84 , srv290744357:84 , srv307648072:84 , srv313944078:84 , srv326303536:84 , srv394456513:84 , srv716577806:84 , srv740389338:84 , srv746246278:84 , srv785082348:84 , srv791806127:84 , srv803137380:84 , srv805994755:84 , srv848144516:84 , srv870020433:84 , srv953200803:84 , srv1007832754:85 , srv1143339008:85 , srv1145373420:85 , srv1155001407:85 , srv1234249936:85 , srv1317257553:85 , srv1342932050:85 , srv1368590818:85 , srv1409458345:85 , srv1454424321:85 , srv1486751292:85 , srv1526327898:85 , srv1531901782:85 , srv1626211922:85 , srv1658686565:85 , srv1671049522:85 , srv1821428802:85 , srv1875209732:85 , srv1902928928:85 , srv1930053253:85 , srv2004749770:85 , srv2068859361:85 , srv2072893416:85 , srv2092712547:85 , srv2102161493:85 , srv290769091:85 , srv497824975:85 , srv521039361:85 , srv562055697:85 , srv599174907:85 , srv606853961:85 , srv610842254:85 , srv679997055:85 , srv800484739:85 , srv806733370:85 , srv836056059:85 , srv941286187:85 , srv1316260684:86 , srv142403091:86 , srv1697887464:86 , srv1966772831:86 , srv20137378:86 , srv919705473:86 , srv1132775313:648 }
2023-11-17 14:58:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:42,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1234249936=11, srv800484739=90, srv142403091=23, srv2081433581=59, srv606658808=79, srv1658686565=33, srv2004749770=50, srv1333647914=18, srv941286187=98, srv1155001407=9, srv1930053253=46, srv1671049522=34, srv1493616080=27, srv1190249029=10, srv12875071=15, srv1645247855=32, srv805994755=92, srv20137378=53, srv1240172608=12, srv1526327898=28, srv1694994339=36, srv1342932050=19, srv1143339008=7, srv1626211922=31, srv2006302981=51, srv1317257553=17, srv242187066=67, srv1782146124=40, srv2000992478=49, srv290744357=68, srv1685665014=35, srv1007832754=0, srv1852952525=43, srv226869057=66, srv1775449816=39, srv2086056551=60, srv870020433=96, srv1365157657=20, srv795240696=89, srv1832220025=42, srv2072893416=58, srv1258910876=13, srv1697887464=37, srv1080201466=5, srv610842254=81, srv2142255690=64, srv1875209732=44, srv2009056525=52, srv836056059=94, srv2036442360=54, srv1454424321=25, srv1902928928=45, srv521039361=75, srv599174907=77, srv2113778746=63, srv1425160811=24, srv1271415180=14, srv1953599359=47, srv2068859361=56, srv606853961=80, srv848144516=95, srv1966772831=48, srv758408303=86, srv307648072=70, srv1761109181=38, srv1316260684=16, srv1056598119=3, srv716577806=83, srv2102161493=62, srv605089285=78, srv1486751292=26, srv1052855548=2, srv1564827866=30, srv806733370=93, srv497824975=74, srv216971936=65, srv1132775313=6, srv791806127=88, srv1021694311=1, srv679997055=82, srv746246278=85, srv803137380=91, srv2072643198=57, srv1145373420=8, srv953200803=99, srv394456513=73, srv740389338=84, srv562055697=76, srv10678024=4, srv1821428802=41, srv290769091=69, srv785082348=87, srv2092712547=61, srv313944078=71, srv326303536=72, srv919705473=97, srv1409458345=22, srv1368590818=21, srv1531901782=29, srv2052077796=55} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:42,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:42,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:42,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:42,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:42,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-17 14:58:42,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-17 14:58:42,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-17 14:58:42,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-17 14:58:42,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-17 14:58:42,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-17 14:58:42,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-17 14:58:42,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-17 14:58:42,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-17 14:58:42,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.0805679407009976E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:42,984 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv606658808:82 , srv1052855548:83 , srv1190249029:83 , srv1564827866:83 , srv1782146124:83 , srv1832220025:83 , srv1953599359:83 , srv2036442360:83 , srv226869057:83 , srv605089285:83 , srv758408303:83 , srv795240696:83 , srv1021694311:84 , srv1056598119:84 , srv10678024:84 , srv1080201466:84 , srv1240172608:84 , srv1258910876:84 , srv1271415180:84 , srv12875071:84 , srv1333647914:84 , srv1365157657:84 , srv1425160811:84 , srv1493616080:84 , srv1645247855:84 , srv1685665014:84 , srv1694994339:84 , srv1761109181:84 , srv1775449816:84 , srv1852952525:84 , srv2000992478:84 , srv2006302981:84 , srv2009056525:84 , srv2052077796:84 , srv2072643198:84 , srv2081433581:84 , srv2086056551:84 , srv2113778746:84 , srv2142255690:84 , srv216971936:84 , srv242187066:84 , srv290744357:84 , srv307648072:84 , srv313944078:84 , srv326303536:84 , srv394456513:84 , srv716577806:84 , srv740389338:84 , srv746246278:84 , srv785082348:84 , srv791806127:84 , srv803137380:84 , srv805994755:84 , srv848144516:84 , srv870020433:84 , srv953200803:84 , srv1007832754:85 , srv1143339008:85 , srv1145373420:85 , srv1155001407:85 , srv1234249936:85 , srv1317257553:85 , srv1342932050:85 , srv1368590818:85 , srv1409458345:85 , srv1454424321:85 , srv1486751292:85 , srv1526327898:85 , srv1531901782:85 , srv1626211922:85 , srv1658686565:85 , srv1671049522:85 , srv1821428802:85 , srv1875209732:85 , srv1902928928:85 , srv1930053253:85 , srv2004749770:85 , srv2068859361:85 , srv2072893416:85 , srv2092712547:85 , srv2102161493:85 , srv290769091:85 , srv497824975:85 , srv521039361:85 , srv562055697:85 , srv599174907:85 , srv606853961:85 , srv610842254:85 , srv679997055:85 , srv800484739:85 , srv806733370:85 , srv836056059:85 , srv941286187:85 , srv1316260684:86 , srv142403091:86 , srv1697887464:86 , srv1966772831:86 , srv20137378:86 , srv919705473:86 , srv1132775313:648 }
2023-11-17 14:58:43,019 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 239), ProcessCount=168 (was 168), AvailableMemoryMB=4721 (was 5210)
2023-11-17 14:58:43,029 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=168, AvailableMemoryMB=4721
2023-11-17 14:58:43,030 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-17 14:58:43,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-17 14:58:43,042 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1135158894:84 , srv1184456727:84 , srv1186973610:84 , srv1194672760:84 , srv1290519409:84 , srv1404215470:84 , srv1529658558:84 , srv1652307440:84 , srv1801955669:84 , srv1857366476:84 , srv1906470156:84 , srv2070662988:84 , srv2121623772:84 , srv248375396:84 , srv293391017:84 , srv324951738:84 , srv346365589:84 , srv462290208:84 , srv511430771:84 , srv529702498:84 , srv578739450:84 , srv668546458:84 , srv76150122:84 , srv807976603:84 , srv814389988:84 , srv828276302:84 , srv83799070:84 , srv85367484:84 , srv90697133:84 , srv24725869:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-17 14:58:43,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 14:58:43,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv462290208=18, srv807976603=24, srv1529658558=6, srv1906470156=10, srv2070662988=11, srv814389988=25, srv1194672760=3, srv1135158894=0, srv1186973610=2, srv668546458=22, srv1652307440=7, srv24725869=13, srv1184456727=1, srv1857366476=9, srv529702498=20, srv248375396=14, srv324951738=16, srv1404215470=5, srv1801955669=8, srv346365589=17, srv90697133=29, srv511430771=19, srv828276302=26, srv2121623772=12, srv76150122=23, srv85367484=28, srv1290519409=4, srv83799070=27, srv578739450=21, srv293391017=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 14:58:43,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 14:58:43,058 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 14:58:43,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-17 14:58:43,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.133529501956206, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 14:58:43,081 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912613790364804, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.133529501956206, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-17 15:00:43,063 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9663383 different iterations.  Found a solution that moves 1827 regions; Going from a computed imbalance of 0.9912613790364804 to a new imbalance of 4.264309142906872E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6766666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 15:00:43,071 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1135158894:90 , srv1184456727:90 , srv1186973610:90 , srv1194672760:90 , srv1290519409:90 , srv1404215470:90 , srv1529658558:90 , srv1652307440:90 , srv1801955669:90 , srv1857366476:90 , srv1906470156:90 , srv2070662988:90 , srv2121623772:90 , srv24725869:90 , srv248375396:90 , srv293391017:90 , srv324951738:90 , srv346365589:90 , srv462290208:90 , srv511430771:90 , srv529702498:90 , srv578739450:90 , srv668546458:90 , srv76150122:90 , srv807976603:90 , srv814389988:90 , srv828276302:90 , srv83799070:90 , srv85367484:90 , srv90697133:90 }
2023-11-17 15:00:43,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-17 15:00:43,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv462290208=18, srv807976603=24, srv1529658558=6, srv1906470156=10, srv2070662988=11, srv814389988=25, srv1194672760=3, srv1135158894=0, srv1186973610=2, srv668546458=22, srv1652307440=7, srv24725869=13, srv1184456727=1, srv1857366476=9, srv529702498=20, srv248375396=14, srv324951738=16, srv1404215470=5, srv1801955669=8, srv346365589=17, srv90697133=29, srv511430771=19, srv828276302=26, srv2121623772=12, srv76150122=23, srv85367484=28, srv1290519409=4, srv83799070=27, srv578739450=21, srv293391017=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-17 15:00:43,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-17 15:00:43,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-17 15:00:43,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-17 15:00:43,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-17 15:00:43,093 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1135158894:90 , srv1184456727:90 , srv1186973610:90 , srv1194672760:90 , srv1290519409:90 , srv1404215470:90 , srv1529658558:90 , srv1652307440:90 , srv1801955669:90 , srv1857366476:90 , srv1906470156:90 , srv2070662988:90 , srv2121623772:90 , srv24725869:90 , srv248375396:90 , srv293391017:90 , srv324951738:90 , srv346365589:90 , srv462290208:90 , srv511430771:90 , srv529702498:90 , srv578739450:90 , srv668546458:90 , srv76150122:90 , srv807976603:90 , srv814389988:90 , srv828276302:90 , srv83799070:90 , srv85367484:90 , srv90697133:90 }
2023-11-17 15:00:43,112 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 239), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4843 (was 4721) - AvailableMemoryMB LEAK? -