2023-09-25 17:53:11,846 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-25 17:53:12,177 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-25 17:53:12,288 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-25 17:53:12,353 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 17:53:12,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 17:53:12,375 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=171, AvailableMemoryMB=8537
2023-09-25 17:53:12,377 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 17:53:12,378 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 17:53:12,530 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000774517:84 , srv100440840:84 , srv1034973987:84 , srv1048538965:84 , srv106448616:84 , srv1105279777:84 , srv1127294400:84 , srv1151666304:84 , srv1159647406:84 , srv11622838:84 , srv1165490452:84 , srv1168784929:84 , srv1178030542:84 , srv1182459281:84 , srv1183048509:84 , srv1185967066:84 , srv1193968569:84 , srv1205959458:84 , srv1222392178:84 , srv122532658:84 , srv1236549519:84 , srv1247512950:84 , srv1274851730:84 , srv127551680:84 , srv1279962870:84 , srv1283453238:84 , srv1289846112:84 , srv1305540041:84 , srv1313361010:84 , srv1314967195:84 , srv131504775:84 , srv1317451306:84 , srv1335682198:84 , srv1378982849:84 , srv1412891712:84 , srv1450509031:84 , srv1459016643:84 , srv1485940907:84 , srv1576335560:84 , srv1584951561:84 , srv1604399835:84 , srv1624801861:84 , srv1704991828:84 , srv1722752239:84 , srv1734503293:84 , srv1742948805:84 , srv1759380974:84 , srv1796187487:84 , srv1841206115:84 , srv1860073676:84 , srv1932839219:84 , srv1933630374:84 , srv1959234453:84 , srv1968118462:84 , srv1971738751:84 , srv1974019498:84 , srv1999861786:84 , srv2046301635:84 , srv2059269059:84 , srv2067633944:84 , srv2079249315:84 , srv2082120485:84 , srv2099886149:84 , srv2127810761:84 , srv2132356070:84 , srv249446141:84 , srv27897911:84 , srv298873495:84 , srv309318252:84 , srv315613391:84 , srv328084790:84 , srv375679748:84 , srv387542924:84 , srv409866465:84 , srv43613224:84 , srv438873527:84 , srv480455512:84 , srv489175860:84 , srv490313052:84 , srv533969314:84 , srv5577382:84 , srv567873965:84 , srv570428225:84 , srv636832070:84 , srv691071866:84 , srv703589196:84 , srv731524192:84 , srv7379796:84 , srv748715767:84 , srv789125653:84 , srv800292513:84 , srv817118296:84 , srv818478343:84 , srv833236409:84 , srv863558575:84 , srv882411120:84 , srv886846710:84 , srv890131346:84 , srv990041353:84 , srv1834347559:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-25 17:53:12,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:12,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:12,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:12,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:12,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:12,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:12,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:12,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:12,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:12,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:12,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:12,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:12,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:12,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:12,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:12,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:12,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:12,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:12,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:12,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:12,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:12,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:12,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:12,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:12,910 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:12,910 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 17:53:12,911 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 17:53:13,259 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 559 ms to try 5000 different iterations.  Found a solution that moves 4706 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17657150992745754. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392649763958671, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05839991390304678, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5228888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392649763958671, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:13,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1034973987:82 , srv1168784929:82 , srv1178030542:82 , srv1305540041:82 , srv1584951561:82 , srv1127294400:83 , srv1205959458:83 , srv1236549519:83 , srv1933630374:83 , srv1968118462:83 , srv1048538965:84 , srv1105279777:84 , srv1247512950:84 , srv1274851730:84 , srv131504775:84 , srv1450509031:84 , srv1860073676:84 , srv2067633944:84 , srv2082120485:84 , srv27897911:84 , srv636832070:84 , srv703589196:84 , srv1193968569:85 , srv122532658:85 , srv1796187487:85 , srv2046301635:85 , srv2059269059:85 , srv2132356070:85 , srv309318252:85 , srv315613391:85 , srv480455512:85 , srv490313052:85 , srv691071866:85 , srv863558575:85 , srv886846710:85 , srv1222392178:86 , srv1283453238:86 , srv1289846112:86 , srv1378982849:86 , srv1485940907:86 , srv1624801861:86 , srv1742948805:86 , srv1932839219:86 , srv1999861786:86 , srv2127810761:86 , srv567873965:86 , srv818478343:86 , srv1000774517:87 , srv1159647406:87 , srv11622838:87 , srv1165490452:87 , srv1182459281:87 , srv1183048509:87 , srv1313361010:87 , srv1314967195:87 , srv1335682198:87 , srv1704991828:87 , srv1722752239:87 , srv1759380974:87 , srv1971738751:87 , srv2079249315:87 , srv375679748:87 , srv409866465:87 , srv438873527:87 , srv570428225:87 , srv731524192:87 , srv748715767:87 , srv789125653:87 , srv800292513:87 , srv817118296:87 , srv833236409:87 , srv100440840:88 , srv106448616:88 , srv1151666304:88 , srv1185967066:88 , srv1279962870:88 , srv1412891712:88 , srv1959234453:88 , srv1974019498:88 , srv2099886149:88 , srv249446141:88 , srv387542924:88 , srv7379796:88 , srv882411120:88 , srv1317451306:89 , srv1459016643:89 , srv1576335560:89 , srv1841206115:89 , srv43613224:89 , srv489175860:89 , srv890131346:89 , srv1604399835:90 , srv5577382:91 , srv990041353:91 , srv533969314:92 , srv127551680:93 , srv1734503293:93 , srv298873495:93 , srv328084790:93 , srv1834347559:439 }
2023-09-25 17:53:13,309 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:13,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:13,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:13,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:13,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:13,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:13,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:13,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:13,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:13,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:13,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:13,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:13,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:13,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:13,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:13,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:13,500 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392649763958671, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05839991390304678, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392649763958671, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:13,500 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 17:53:13,501 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17653855781115785, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392649763958671, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05839991390304678, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392649763958671, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17166666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23925, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 17:53:13,807 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 2639 regions; Going from a computed imbalance of 0.17653855781115785 to a new imbalance of 0.015213524961250311. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02159611812905667); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03253246673240019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2932222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02159611812905667); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:13,817 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1734503293:78 , srv127551680:79 , srv298873495:79 , srv533969314:80 , srv1317451306:81 , srv1576335560:81 , srv1604399835:81 , srv328084790:81 , srv1459016643:82 , srv990041353:82 , srv100440840:83 , srv1183048509:83 , srv1185967066:83 , srv1841206115:83 , srv387542924:83 , srv409866465:83 , srv43613224:83 , srv5577382:83 , srv570428225:83 , srv1165490452:84 , srv1182459281:84 , srv1279962870:84 , srv1313361010:84 , srv1314967195:84 , srv1704991828:84 , srv1959234453:84 , srv1971738751:84 , srv2079249315:84 , srv2099886149:84 , srv249446141:84 , srv438873527:84 , srv7379796:84 , srv833236409:84 , srv1151666304:85 , srv1159647406:85 , srv1289846112:85 , srv1335682198:85 , srv1378982849:85 , srv1796187487:85 , srv1932839219:85 , srv375679748:85 , srv567873965:85 , srv789125653:85 , srv800292513:85 , srv882411120:85 , srv886846710:85 , srv1000774517:86 , srv106448616:86 , srv1222392178:86 , srv1412891712:86 , srv1485940907:86 , srv1624801861:86 , srv1722752239:86 , srv1999861786:86 , srv489175860:86 , srv490313052:86 , srv691071866:86 , srv703589196:86 , srv731524192:86 , srv817118296:86 , srv890131346:86 , srv11622838:87 , srv122532658:87 , srv1283453238:87 , srv131504775:87 , srv1974019498:87 , srv2067633944:87 , srv2127810761:87 , srv27897911:87 , srv309318252:87 , srv480455512:87 , srv748715767:87 , srv818478343:87 , srv1105279777:88 , srv1178030542:88 , srv1193968569:88 , srv1205959458:88 , srv1450509031:88 , srv1742948805:88 , srv1933630374:88 , srv2046301635:88 , srv2059269059:88 , srv2082120485:88 , srv2132356070:88 , srv636832070:88 , srv863558575:88 , srv1034973987:89 , srv1048538965:89 , srv1168784929:89 , srv1236549519:89 , srv1247512950:89 , srv1274851730:89 , srv1759380974:89 , srv315613391:89 , srv1127294400:90 , srv1305540041:90 , srv1860073676:90 , srv1968118462:90 , srv1584951561:91 , srv1834347559:527 }
2023-09-25 17:53:13,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:13,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:13,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:13,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:13,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:13,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:13,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:13,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:13,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:13,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:13,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:13,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:13,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:13,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:13,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:13,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:13,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:13,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:14,015 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02159611812905667); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03253246673240019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02159611812905667); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:14,016 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 17:53:14,016 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015195046288297714, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02159611812905667); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03253246673240019, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02159611812905667); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.041833333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 17:53:14,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 594 ms to try 5000 different iterations.  Found a solution that moves 961 regions; Going from a computed imbalance of 0.015195046288297714 to a new imbalance of 7.505836086263224E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006217570812329759); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0069307946660236135); MoveCostFunction : (multiplier=7.0, imbalance=0.10677777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006217570812329759); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:14,467 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1759380974:81 , srv1974019498:82 , srv106448616:83 , srv11622838:83 , srv1193968569:83 , srv1860073676:83 , srv328084790:83 , srv489175860:83 , srv748715767:83 , srv890131346:83 , srv1000774517:84 , srv1048538965:84 , srv1127294400:84 , srv1151666304:84 , srv1274851730:84 , srv1283453238:84 , srv1412891712:84 , srv1584951561:84 , srv1722752239:84 , srv1742948805:84 , srv1999861786:84 , srv2046301635:84 , srv2059269059:84 , srv2127810761:84 , srv315613391:84 , srv480455512:84 , srv5577382:84 , srv636832070:84 , srv818478343:84 , srv863558575:84 , srv882411120:84 , srv990041353:84 , srv1205959458:85 , srv122532658:85 , srv1247512950:85 , srv127551680:85 , srv1485940907:85 , srv1968118462:85 , srv2099886149:85 , srv2132356070:85 , srv298873495:85 , srv309318252:85 , srv731524192:85 , srv7379796:85 , srv817118296:85 , srv100440840:86 , srv1034973987:86 , srv1105279777:86 , srv1159647406:86 , srv1165490452:86 , srv1185967066:86 , srv1222392178:86 , srv1236549519:86 , srv1279962870:86 , srv1289846112:86 , srv1305540041:86 , srv1313361010:86 , srv131504775:86 , srv1335682198:86 , srv1378982849:86 , srv1450509031:86 , srv1459016643:86 , srv1624801861:86 , srv1841206115:86 , srv1959234453:86 , srv2079249315:86 , srv375679748:86 , srv387542924:86 , srv409866465:86 , srv43613224:86 , srv438873527:86 , srv533969314:86 , srv789125653:86 , srv833236409:86 , srv1168784929:87 , srv1178030542:87 , srv1182459281:87 , srv1183048509:87 , srv1317451306:87 , srv1576335560:87 , srv1604399835:87 , srv1704991828:87 , srv1734503293:87 , srv1932839219:87 , srv1933630374:87 , srv1971738751:87 , srv2067633944:87 , srv2082120485:87 , srv249446141:87 , srv27897911:87 , srv490313052:87 , srv567873965:87 , srv691071866:87 , srv800292513:87 , srv886846710:87 , srv1314967195:88 , srv1796187487:88 , srv570428225:88 , srv703589196:88 , srv1834347559:547 }
2023-09-25 17:53:14,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:14,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:14,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:14,661 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006217570812329759); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0069307946660236135); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006217570812329759); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:14,661 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 17:53:14,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.438545428031147E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006217570812329759); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0069307946660236135); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006217570812329759); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 17:53:14,969 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 441 ms to try 5000 different iterations.  Found a solution that moves 251 regions; Going from a computed imbalance of 7.438545428031147E-4 to a new imbalance of 2.845114131749511E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.02788888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:14,970 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1314967195:83 , srv2082120485:83 , srv249446141:83 , srv375679748:83 , srv533969314:83 , srv800292513:83 , srv100440840:84 , srv1105279777:84 , srv1159647406:84 , srv1165490452:84 , srv1168784929:84 , srv1182459281:84 , srv1222392178:84 , srv122532658:84 , srv1236549519:84 , srv1247512950:84 , srv1279962870:84 , srv1305540041:84 , srv1335682198:84 , srv1412891712:84 , srv1450509031:84 , srv1604399835:84 , srv1624801861:84 , srv1734503293:84 , srv1742948805:84 , srv1796187487:84 , srv1841206115:84 , srv1932839219:84 , srv1933630374:84 , srv1959234453:84 , srv1968118462:84 , srv2046301635:84 , srv2067633944:84 , srv2132356070:84 , srv27897911:84 , srv315613391:84 , srv43613224:84 , srv489175860:84 , srv490313052:84 , srv5577382:84 , srv567873965:84 , srv570428225:84 , srv691071866:84 , srv703589196:84 , srv731524192:84 , srv789125653:84 , srv817118296:84 , srv890131346:84 , srv1000774517:85 , srv1034973987:85 , srv1048538965:85 , srv106448616:85 , srv1127294400:85 , srv1151666304:85 , srv11622838:85 , srv1178030542:85 , srv1183048509:85 , srv1185967066:85 , srv1274851730:85 , srv127551680:85 , srv1283453238:85 , srv1378982849:85 , srv1459016643:85 , srv1485940907:85 , srv1576335560:85 , srv1584951561:85 , srv1704991828:85 , srv1722752239:85 , srv1759380974:85 , srv1860073676:85 , srv1971738751:85 , srv1974019498:85 , srv1999861786:85 , srv2059269059:85 , srv2079249315:85 , srv2099886149:85 , srv2127810761:85 , srv298873495:85 , srv309318252:85 , srv328084790:85 , srv387542924:85 , srv438873527:85 , srv7379796:85 , srv748715767:85 , srv818478343:85 , srv833236409:85 , srv882411120:85 , srv886846710:85 , srv990041353:85 , srv1193968569:86 , srv1289846112:86 , srv1313361010:86 , srv131504775:86 , srv1317451306:86 , srv409866465:86 , srv480455512:86 , srv636832070:86 , srv863558575:86 , srv1205959458:87 , srv1834347559:628 }
2023-09-25 17:53:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:14,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:15,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:15,090 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 17:53:15,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6693601752848763E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 17:53:15,343 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 345 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 2.6693601752848763E-5 to a new imbalance of 7.555809092151254E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:15,343 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1205959458:83 , srv1289846112:83 , srv1313361010:83 , srv131504775:83 , srv1317451306:83 , srv1704991828:83 , srv1971738751:83 , srv863558575:83 , srv1000774517:84 , srv1034973987:84 , srv1048538965:84 , srv106448616:84 , srv1105279777:84 , srv1127294400:84 , srv1151666304:84 , srv1159647406:84 , srv11622838:84 , srv1168784929:84 , srv1178030542:84 , srv1182459281:84 , srv1183048509:84 , srv1185967066:84 , srv1193968569:84 , srv1222392178:84 , srv1236549519:84 , srv1247512950:84 , srv1274851730:84 , srv127551680:84 , srv1279962870:84 , srv1283453238:84 , srv1305540041:84 , srv1314967195:84 , srv1335682198:84 , srv1378982849:84 , srv1412891712:84 , srv1450509031:84 , srv1459016643:84 , srv1485940907:84 , srv1576335560:84 , srv1584951561:84 , srv1604399835:84 , srv1624801861:84 , srv1722752239:84 , srv1734503293:84 , srv1742948805:84 , srv1759380974:84 , srv1796187487:84 , srv1841206115:84 , srv1860073676:84 , srv1932839219:84 , srv1933630374:84 , srv1959234453:84 , srv1968118462:84 , srv1974019498:84 , srv2059269059:84 , srv2067633944:84 , srv2079249315:84 , srv2082120485:84 , srv2099886149:84 , srv2127810761:84 , srv2132356070:84 , srv249446141:84 , srv27897911:84 , srv298873495:84 , srv309318252:84 , srv315613391:84 , srv328084790:84 , srv387542924:84 , srv409866465:84 , srv43613224:84 , srv438873527:84 , srv480455512:84 , srv489175860:84 , srv490313052:84 , srv5577382:84 , srv567873965:84 , srv570428225:84 , srv636832070:84 , srv691071866:84 , srv703589196:84 , srv731524192:84 , srv7379796:84 , srv748715767:84 , srv789125653:84 , srv800292513:84 , srv817118296:84 , srv818478343:84 , srv833236409:84 , srv882411120:84 , srv886846710:84 , srv890131346:84 , srv990041353:84 , srv100440840:85 , srv1165490452:85 , srv122532658:85 , srv1999861786:85 , srv2046301635:85 , srv375679748:85 , srv533969314:85 , srv1834347559:685 }
2023-09-25 17:53:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:15,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1932839219=51, srv2046301635=58, srv131504775=30, srv1314967195=29, srv567873965=82, srv818478343=93, srv817118296=92, srv863558575=95, srv731524192=87, srv1182459281=13, srv1734503293=44, srv438873527=76, srv1378982849=33, srv315613391=70, srv1959234453=53, srv1178030542=12, srv789125653=90, srv1279962870=24, srv1412891712=34, srv122532658=19, srv1000774517=0, srv1105279777=5, srv1841206115=49, srv1048538965=3, srv1151666304=7, srv480455512=77, srv1185967066=15, srv27897911=67, srv328084790=71, srv1205959458=17, srv1459016643=36, srv1183048509=14, srv249446141=66, srv1796187487=47, srv1222392178=18, srv127551680=23, srv1305540041=27, srv533969314=80, srv1247512950=21, srv1289846112=26, srv5577382=81, srv1933630374=52, srv1335682198=32, srv1274851730=22, srv890131346=98, srv1485940907=37, srv1236549519=20, srv1313361010=28, srv636832070=84, srv2067633944=60, srv489175860=78, srv490313052=79, srv1968118462=54, srv2059269059=59, srv1971738751=55, srv1999861786=57, srv748715767=89, srv1604399835=40, srv2099886149=63, srv1127294400=6, srv309318252=69, srv2079249315=61, srv2082120485=62, srv375679748=72, srv1704991828=42, srv1034973987=2, srv1283453238=25, srv1759380974=46, srv100440840=1, srv1584951561=39, srv2132356070=65, srv1860073676=50, srv298873495=68, srv570428225=83, srv882411120=96, srv1317451306=31, srv691071866=85, srv1576335560=38, srv1624801861=41, srv1722752239=43, srv703589196=86, srv43613224=75, srv1165490452=10, srv1450509031=35, srv106448616=4, srv11622838=9, srv1159647406=8, srv990041353=99, srv7379796=88, srv833236409=94, srv409866465=74, srv1834347559=48, srv1168784929=11, srv800292513=91, srv2127810761=64, srv1193968569=16, srv1742948805=45, srv1974019498=56, srv886846710=97, srv387542924=73} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 17:53:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 17:53:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 17:53:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 17:53:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 17:53:15,465 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:15,465 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1205959458:83 , srv1289846112:83 , srv1313361010:83 , srv131504775:83 , srv1317451306:83 , srv1704991828:83 , srv1971738751:83 , srv863558575:83 , srv1000774517:84 , srv1034973987:84 , srv1048538965:84 , srv106448616:84 , srv1105279777:84 , srv1127294400:84 , srv1151666304:84 , srv1159647406:84 , srv11622838:84 , srv1168784929:84 , srv1178030542:84 , srv1182459281:84 , srv1183048509:84 , srv1185967066:84 , srv1193968569:84 , srv1222392178:84 , srv1236549519:84 , srv1247512950:84 , srv1274851730:84 , srv127551680:84 , srv1279962870:84 , srv1283453238:84 , srv1305540041:84 , srv1314967195:84 , srv1335682198:84 , srv1378982849:84 , srv1412891712:84 , srv1450509031:84 , srv1459016643:84 , srv1485940907:84 , srv1576335560:84 , srv1584951561:84 , srv1604399835:84 , srv1624801861:84 , srv1722752239:84 , srv1734503293:84 , srv1742948805:84 , srv1759380974:84 , srv1796187487:84 , srv1841206115:84 , srv1860073676:84 , srv1932839219:84 , srv1933630374:84 , srv1959234453:84 , srv1968118462:84 , srv1974019498:84 , srv2059269059:84 , srv2067633944:84 , srv2079249315:84 , srv2082120485:84 , srv2099886149:84 , srv2127810761:84 , srv2132356070:84 , srv249446141:84 , srv27897911:84 , srv298873495:84 , srv309318252:84 , srv315613391:84 , srv328084790:84 , srv387542924:84 , srv409866465:84 , srv43613224:84 , srv438873527:84 , srv480455512:84 , srv489175860:84 , srv490313052:84 , srv5577382:84 , srv567873965:84 , srv570428225:84 , srv636832070:84 , srv691071866:84 , srv703589196:84 , srv731524192:84 , srv7379796:84 , srv748715767:84 , srv789125653:84 , srv800292513:84 , srv817118296:84 , srv818478343:84 , srv833236409:84 , srv882411120:84 , srv886846710:84 , srv890131346:84 , srv990041353:84 , srv100440840:85 , srv1165490452:85 , srv122532658:85 , srv1999861786:85 , srv2046301635:85 , srv375679748:85 , srv533969314:85 , srv1834347559:685 }
2023-09-25 17:53:15,490 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=7905 (was 8537)
2023-09-25 17:53:15,498 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=171, AvailableMemoryMB=7905
2023-09-25 17:53:15,498 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 17:53:15,499 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-25 17:53:15,507 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1220418994:84 , srv1253716188:84 , srv1264627374:84 , srv129411702:84 , srv1613178012:84 , srv1636451196:84 , srv1690316571:84 , srv17245257:84 , srv18391032:84 , srv1846302781:84 , srv1884944895:84 , srv190124049:84 , srv1914981480:84 , srv2044491788:84 , srv2082584113:84 , srv2123674022:84 , srv2142548009:84 , srv233377663:84 , srv238746921:84 , srv256321359:84 , srv305758411:84 , srv541465263:84 , srv560102668:84 , srv613814326:84 , srv630950716:84 , srv805610104:84 , srv808841226:84 , srv876267992:84 , srv886938066:84 , srv950937627:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-25 17:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:53:15,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1846302781=9, srv2123674022=15, srv233377663=17, srv808841226=26, srv1914981480=12, srv886938066=28, srv17245257=7, srv950937627=29, srv256321359=19, srv190124049=11, srv1220418994=0, srv560102668=22, srv2082584113=14, srv1264627374=2, srv129411702=3, srv2044491788=13, srv1613178012=4, srv1690316571=6, srv805610104=25, srv18391032=8, srv541465263=21, srv876267992=27, srv1636451196=5, srv305758411=20, srv238746921=18, srv1253716188=1, srv2142548009=16, srv1884944895=10, srv613814326=23, srv630950716=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:53:15,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:53:15,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 17:53:15,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1284198881494865, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:53:15,532 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912597690138544, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1284198881494865, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-25 17:55:15,520 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5422324 different iterations.  Found a solution that moves 1869 regions; Going from a computed imbalance of 0.9912597690138544 to a new imbalance of 4.362339238146111E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6922222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:55:15,526 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1220418994:90 , srv1253716188:90 , srv1264627374:90 , srv129411702:90 , srv1613178012:90 , srv1636451196:90 , srv1690316571:90 , srv17245257:90 , srv18391032:90 , srv1846302781:90 , srv1884944895:90 , srv190124049:90 , srv1914981480:90 , srv2044491788:90 , srv2082584113:90 , srv2123674022:90 , srv2142548009:90 , srv233377663:90 , srv238746921:90 , srv256321359:90 , srv305758411:90 , srv541465263:90 , srv560102668:90 , srv613814326:90 , srv630950716:90 , srv805610104:90 , srv808841226:90 , srv876267992:90 , srv886938066:90 , srv950937627:90 }
2023-09-25 17:55:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 17:55:15,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1846302781=9, srv2123674022=15, srv233377663=17, srv808841226=26, srv1914981480=12, srv886938066=28, srv17245257=7, srv950937627=29, srv256321359=19, srv190124049=11, srv1220418994=0, srv560102668=22, srv2082584113=14, srv1264627374=2, srv129411702=3, srv2044491788=13, srv1613178012=4, srv1690316571=6, srv805610104=25, srv18391032=8, srv541465263=21, srv876267992=27, srv1636451196=5, srv305758411=20, srv238746921=18, srv1253716188=1, srv2142548009=16, srv1884944895=10, srv613814326=23, srv630950716=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 17:55:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 17:55:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 17:55:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 17:55:15,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 17:55:15,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 17:55:15,544 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 17:55:15,544 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1220418994:90 , srv1253716188:90 , srv1264627374:90 , srv129411702:90 , srv1613178012:90 , srv1636451196:90 , srv1690316571:90 , srv17245257:90 , srv18391032:90 , srv1846302781:90 , srv1884944895:90 , srv190124049:90 , srv1914981480:90 , srv2044491788:90 , srv2082584113:90 , srv2123674022:90 , srv2142548009:90 , srv233377663:90 , srv238746921:90 , srv256321359:90 , srv305758411:90 , srv541465263:90 , srv560102668:90 , srv613814326:90 , srv630950716:90 , srv805610104:90 , srv808841226:90 , srv876267992:90 , srv886938066:90 , srv950937627:90 }
2023-09-25 17:55:15,556 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=168 (was 266), ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=6764 (was 7905)