2023-12-26 08:53:16,987 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-26 08:53:17,310 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-26 08:53:17,436 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-26 08:53:17,503 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 08:53:17,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-26 08:53:17,526 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=169, AvailableMemoryMB=11802
2023-12-26 08:53:17,528 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 08:53:17,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-26 08:53:17,672 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009183660:84 , srv1023723496:84 , srv1041357564:84 , srv1060225203:84 , srv1094230648:84 , srv1110680080:84 , srv1123602451:84 , srv112948322:84 , srv1140766262:84 , srv1167556288:84 , srv1198849777:84 , srv1207806720:84 , srv1214697349:84 , srv1224560606:84 , srv1226867592:84 , srv1247136740:84 , srv1280186519:84 , srv128322507:84 , srv128820199:84 , srv1289562768:84 , srv1290604290:84 , srv1296638340:84 , srv1322776831:84 , srv1339417878:84 , srv1380715261:84 , srv1447140495:84 , srv1451069172:84 , srv1452979885:84 , srv1475201565:84 , srv1510116449:84 , srv1515460436:84 , srv1516425216:84 , srv1598238466:84 , srv1611962409:84 , srv1648354173:84 , srv1656071318:84 , srv1695085489:84 , srv1714544882:84 , srv1732076536:84 , srv174278465:84 , srv176248421:84 , srv1778656742:84 , srv178757436:84 , srv1792199734:84 , srv1819135367:84 , srv1862430016:84 , srv1871782204:84 , srv1896867016:84 , srv1905725860:84 , srv1909383288:84 , srv1922931356:84 , srv1923031109:84 , srv1933853166:84 , srv19509307:84 , srv198688113:84 , srv2015365491:84 , srv2059019684:84 , srv20747779:84 , srv2081079716:84 , srv2097443819:84 , srv2100617405:84 , srv2108197405:84 , srv2125371490:84 , srv2127393440:84 , srv2146117287:84 , srv228647387:84 , srv232392042:84 , srv305431329:84 , srv348257152:84 , srv422659679:84 , srv456449065:84 , srv470103809:84 , srv484304855:84 , srv485937575:84 , srv494114781:84 , srv509560829:84 , srv576248034:84 , srv58574883:84 , srv593260624:84 , srv594027719:84 , srv600384574:84 , srv606296399:84 , srv623059396:84 , srv628700221:84 , srv642310736:84 , srv649165414:84 , srv652291871:84 , srv652927051:84 , srv663622897:84 , srv70580983:84 , srv756471940:84 , srv770215638:84 , srv798002778:84 , srv811742328:84 , srv921307494:84 , srv921614329:84 , srv932518714:84 , srv939447206:84 , srv966548994:84 , srv16949765:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-26 08:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:17,688 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:17,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:17,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:17,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:17,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:17,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:17,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:17,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:17,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:17,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:17,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:17,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:17,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:17,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:17,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:17,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:17,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:17,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:17,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:17,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:18,194 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:18,195 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 08:53:18,195 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 08:53:18,599 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 777 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18238228910955043. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038615844407853976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05671121243776769, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038615844407853976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:18,623 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv128322507:81 , srv1023723496:82 , srv642310736:82 , srv932518714:82 , srv112948322:83 , srv1214697349:83 , srv1451069172:83 , srv1510116449:83 , srv1656071318:83 , srv1778656742:83 , srv2081079716:83 , srv2097443819:83 , srv228647387:83 , srv652927051:83 , srv1452979885:84 , srv176248421:84 , srv1862430016:84 , srv1896867016:84 , srv19509307:84 , srv2127393440:84 , srv348257152:84 , srv485937575:84 , srv593260624:84 , srv770215638:84 , srv798002778:84 , srv966548994:84 , srv1041357564:85 , srv1322776831:85 , srv1339417878:85 , srv1380715261:85 , srv174278465:85 , srv1923031109:85 , srv2015365491:85 , srv456449065:85 , srv509560829:85 , srv939447206:85 , srv1123602451:86 , srv1167556288:86 , srv128820199:86 , srv1516425216:86 , srv1611962409:86 , srv1714544882:86 , srv1819135367:86 , srv2059019684:86 , srv2100617405:86 , srv232392042:86 , srv494114781:86 , srv594027719:86 , srv623059396:86 , srv628700221:86 , srv663622897:86 , srv1060225203:87 , srv1247136740:87 , srv1515460436:87 , srv1648354173:87 , srv1695085489:87 , srv1871782204:87 , srv1909383288:87 , srv1922931356:87 , srv2146117287:87 , srv484304855:87 , srv756471940:87 , srv921307494:87 , srv1198849777:88 , srv1207806720:88 , srv1289562768:88 , srv1290604290:88 , srv1447140495:88 , srv1475201565:88 , srv1732076536:88 , srv1792199734:88 , srv1905725860:88 , srv1933853166:88 , srv20747779:88 , srv305431329:88 , srv600384574:88 , srv1009183660:89 , srv1110680080:89 , srv1224560606:89 , srv1226867592:89 , srv1296638340:89 , srv198688113:89 , srv2108197405:89 , srv470103809:89 , srv576248034:89 , srv58574883:89 , srv652291871:89 , srv921614329:89 , srv1140766262:90 , srv178757436:90 , srv606296399:90 , srv649165414:90 , srv811742328:90 , srv2125371490:91 , srv422659679:91 , srv70580983:91 , srv1598238466:92 , srv1094230648:94 , srv1280186519:97 , srv16949765:433 }
2023-12-26 08:53:18,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:18,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:18,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:18,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:18,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:18,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:18,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:18,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:18,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:18,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:18,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:18,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:18,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:18,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:18,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:18,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:18,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:18,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:18,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:18,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:18,796 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038615844407853976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05671121243776769, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038615844407853976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:18,796 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 08:53:18,797 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18234961707923714, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038615844407853976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05671121243776769, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038615844407853976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24391666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 08:53:19,046 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 360 ms to try 5000 different iterations.  Found a solution that moves 2701 regions; Going from a computed imbalance of 0.18234961707923714 to a new imbalance of 0.018532341289446183. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020262032076849477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03448515027117599, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3001111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020262032076849477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015833333333333335); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:19,061 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1280186519:76 , srv1094230648:78 , srv2125371490:80 , srv1207806720:81 , srv1598238466:81 , srv422659679:81 , srv1224560606:82 , srv1695085489:82 , srv178757436:82 , srv470103809:82 , srv70580983:82 , srv811742328:82 , srv1009183660:83 , srv1110680080:83 , srv1226867592:83 , srv1290604290:83 , srv1475201565:83 , srv198688113:83 , srv576248034:83 , srv58574883:83 , srv756471940:83 , srv1140766262:84 , srv1648354173:84 , srv1714544882:84 , srv1792199734:84 , srv1905725860:84 , srv1909383288:84 , srv1922931356:84 , srv1933853166:84 , srv2108197405:84 , srv600384574:84 , srv606296399:84 , srv628700221:84 , srv649165414:84 , srv652291871:84 , srv663622897:84 , srv1198849777:85 , srv1247136740:85 , srv128820199:85 , srv1296638340:85 , srv1447140495:85 , srv2059019684:85 , srv20747779:85 , srv2100617405:85 , srv2146117287:85 , srv305431329:85 , srv484304855:85 , srv921614329:85 , srv1123602451:86 , srv1380715261:86 , srv1515460436:86 , srv1516425216:86 , srv1611962409:86 , srv1732076536:86 , srv1819135367:86 , srv1862430016:86 , srv1871782204:86 , srv1923031109:86 , srv2015365491:86 , srv494114781:86 , srv509560829:86 , srv623059396:86 , srv921307494:86 , srv1214697349:87 , srv1289562768:87 , srv1339417878:87 , srv174278465:87 , srv176248421:87 , srv232392042:87 , srv348257152:87 , srv456449065:87 , srv932518714:87 , srv1041357564:88 , srv1060225203:88 , srv1167556288:88 , srv1322776831:88 , srv1452979885:88 , srv2127393440:88 , srv228647387:88 , srv593260624:88 , srv128322507:89 , srv1510116449:89 , srv1656071318:89 , srv1778656742:89 , srv2081079716:89 , srv485937575:89 , srv770215638:89 , srv966548994:89 , srv1023723496:90 , srv112948322:90 , srv1451069172:90 , srv1896867016:90 , srv19509307:90 , srv2097443819:90 , srv652927051:90 , srv798002778:90 , srv594027719:91 , srv939447206:91 , srv642310736:92 , srv16949765:521 }
2023-12-26 08:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:19,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:19,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:19,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:19,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:19,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:19,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:19,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:19,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:19,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:19,204 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020262032076849477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03448515027117599, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020262032076849477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015833333333333335); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:19,204 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 08:53:19,205 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.018513428483214668, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020262032076849477); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03448515027117599, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020262032076849477); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015833333333333335); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 08:53:19,536 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 1011 regions; Going from a computed imbalance of 0.018513428483214668 to a new imbalance of 7.500434383445602E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008395391820274807); MoveCostFunction : (multiplier=7.0, imbalance=0.11233333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:19,538 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv594027719:80 , srv939447206:81 , srv1060225203:82 , srv1896867016:83 , srv19509307:83 , srv606296399:83 , srv798002778:83 , srv112948322:84 , srv1140766262:84 , srv1167556288:84 , srv1289562768:84 , srv1296638340:84 , srv1447140495:84 , srv1515460436:84 , srv1732076536:84 , srv174278465:84 , srv1871782204:84 , srv2108197405:84 , srv305431329:84 , srv58574883:84 , srv623059396:84 , srv642310736:84 , srv649165414:84 , srv652291871:84 , srv770215638:84 , srv921307494:84 , srv1009183660:85 , srv1023723496:85 , srv1041357564:85 , srv1094230648:85 , srv1198849777:85 , srv1247136740:85 , srv1322776831:85 , srv1339417878:85 , srv1452979885:85 , srv1510116449:85 , srv1598238466:85 , srv1656071318:85 , srv1778656742:85 , srv1819135367:85 , srv20747779:85 , srv2081079716:85 , srv2097443819:85 , srv2125371490:85 , srv2146117287:85 , srv232392042:85 , srv456449065:85 , srv470103809:85 , srv485937575:85 , srv593260624:85 , srv652927051:85 , srv70580983:85 , srv921614329:85 , srv966548994:85 , srv1110680080:86 , srv1123602451:86 , srv1224560606:86 , srv1226867592:86 , srv1280186519:86 , srv128820199:86 , srv1290604290:86 , srv1451069172:86 , srv1516425216:86 , srv1611962409:86 , srv1648354173:86 , srv176248421:86 , srv178757436:86 , srv1792199734:86 , srv1905725860:86 , srv1922931356:86 , srv1923031109:86 , srv1933853166:86 , srv198688113:86 , srv2015365491:86 , srv2059019684:86 , srv2100617405:86 , srv228647387:86 , srv348257152:86 , srv484304855:86 , srv494114781:86 , srv509560829:86 , srv576248034:86 , srv600384574:86 , srv811742328:86 , srv1214697349:87 , srv128322507:87 , srv1475201565:87 , srv1862430016:87 , srv1909383288:87 , srv2127393440:87 , srv422659679:87 , srv628700221:87 , srv663622897:87 , srv756471940:87 , srv1207806720:88 , srv1380715261:88 , srv1695085489:88 , srv1714544882:88 , srv932518714:88 , srv16949765:559 }
2023-12-26 08:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:19,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:19,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:19,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:19,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:19,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:19,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:19,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:19,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:19,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:19,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:19,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:19,671 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008395391820274807); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:19,671 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 08:53:19,671 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.429642650383554E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00622158085519251); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008395391820274807); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00622158085519251); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 08:53:19,888 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 317 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 7.429642650383554E-4 to a new imbalance of 3.407730380478085E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:19,889 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1140766262:83 , srv1280186519:83 , srv1289562768:83 , srv1380715261:83 , srv1451069172:83 , srv422659679:83 , srv70580983:83 , srv921614329:83 , srv1009183660:84 , srv1041357564:84 , srv1110680080:84 , srv1123602451:84 , srv1167556288:84 , srv1198849777:84 , srv1226867592:84 , srv128322507:84 , srv1296638340:84 , srv1322776831:84 , srv1475201565:84 , srv1598238466:84 , srv1611962409:84 , srv1656071318:84 , srv1714544882:84 , srv1732076536:84 , srv178757436:84 , srv1792199734:84 , srv1896867016:84 , srv1905725860:84 , srv1909383288:84 , srv1933853166:84 , srv198688113:84 , srv20747779:84 , srv2097443819:84 , srv2127393440:84 , srv232392042:84 , srv485937575:84 , srv494114781:84 , srv576248034:84 , srv642310736:84 , srv649165414:84 , srv652927051:84 , srv770215638:84 , srv966548994:84 , srv1023723496:85 , srv1060225203:85 , srv1094230648:85 , srv112948322:85 , srv1207806720:85 , srv1214697349:85 , srv1224560606:85 , srv1247136740:85 , srv128820199:85 , srv1290604290:85 , srv1339417878:85 , srv1447140495:85 , srv1452979885:85 , srv1510116449:85 , srv1515460436:85 , srv1516425216:85 , srv1648354173:85 , srv174278465:85 , srv176248421:85 , srv1778656742:85 , srv1819135367:85 , srv1862430016:85 , srv1871782204:85 , srv1922931356:85 , srv1923031109:85 , srv19509307:85 , srv2015365491:85 , srv2059019684:85 , srv2081079716:85 , srv2100617405:85 , srv2108197405:85 , srv2146117287:85 , srv228647387:85 , srv305431329:85 , srv456449065:85 , srv484304855:85 , srv509560829:85 , srv593260624:85 , srv594027719:85 , srv600384574:85 , srv606296399:85 , srv628700221:85 , srv652291871:85 , srv663622897:85 , srv756471940:85 , srv798002778:85 , srv811742328:85 , srv921307494:85 , srv939447206:85 , srv1695085489:86 , srv2125371490:86 , srv348257152:86 , srv470103809:86 , srv58574883:86 , srv623059396:86 , srv932518714:86 , srv16949765:629 }
2023-12-26 08:53:19,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:19,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:20,022 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:20,022 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 08:53:20,023 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2347772838774294E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 08:53:20,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 315 ms to try 5000 different iterations.  Found a solution that moves 18 regions; Going from a computed imbalance of 3.2347772838774294E-5 to a new imbalance of 7.199277990208469E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.002); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:20,235 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1516425216:83 , srv1695085489:83 , srv2127393440:83 , srv348257152:83 , srv484304855:83 , srv600384574:83 , srv811742328:83 , srv932518714:83 , srv1023723496:84 , srv1041357564:84 , srv1060225203:84 , srv1094230648:84 , srv1110680080:84 , srv1123602451:84 , srv112948322:84 , srv1167556288:84 , srv1198849777:84 , srv1207806720:84 , srv1214697349:84 , srv1224560606:84 , srv1226867592:84 , srv1247136740:84 , srv1280186519:84 , srv128820199:84 , srv1289562768:84 , srv1290604290:84 , srv1296638340:84 , srv1322776831:84 , srv1339417878:84 , srv1380715261:84 , srv1447140495:84 , srv1451069172:84 , srv1452979885:84 , srv1475201565:84 , srv1510116449:84 , srv1515460436:84 , srv1598238466:84 , srv1611962409:84 , srv1648354173:84 , srv1714544882:84 , srv1732076536:84 , srv176248421:84 , srv1778656742:84 , srv178757436:84 , srv1792199734:84 , srv1819135367:84 , srv1862430016:84 , srv1871782204:84 , srv1905725860:84 , srv1909383288:84 , srv1922931356:84 , srv1923031109:84 , srv1933853166:84 , srv19509307:84 , srv198688113:84 , srv2015365491:84 , srv2059019684:84 , srv20747779:84 , srv2081079716:84 , srv2097443819:84 , srv2100617405:84 , srv2108197405:84 , srv2125371490:84 , srv2146117287:84 , srv228647387:84 , srv232392042:84 , srv305431329:84 , srv422659679:84 , srv456449065:84 , srv470103809:84 , srv485937575:84 , srv494114781:84 , srv509560829:84 , srv576248034:84 , srv58574883:84 , srv593260624:84 , srv594027719:84 , srv606296399:84 , srv623059396:84 , srv628700221:84 , srv642310736:84 , srv649165414:84 , srv652291871:84 , srv652927051:84 , srv663622897:84 , srv756471940:84 , srv798002778:84 , srv921307494:84 , srv921614329:84 , srv939447206:84 , srv966548994:84 , srv1009183660:85 , srv1140766262:85 , srv128322507:85 , srv1656071318:85 , srv174278465:85 , srv1896867016:85 , srv70580983:85 , srv770215638:85 , srv16949765:684 }
2023-12-26 08:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:20,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1290604290=20, srv1339417878=23, srv2108197405=62, srv2081079716=59, srv652291871=87, srv649165414=86, srv2015365491=56, srv1280186519=16, srv1322776831=22, srv1516425216=31, srv1207806720=11, srv1198849777=10, srv1933853166=53, srv628700221=84, srv939447206=98, srv20747779=58, srv1009183660=0, srv228647387=66, srv1060225203=3, srv178757436=43, srv232392042=67, srv1922931356=51, srv484304855=73, srv2146117287=65, srv1296638340=21, srv2097443819=60, srv921307494=95, srv1247136740=15, srv1167556288=9, srv1515460436=30, srv470103809=72, srv606296399=82, srv19509307=54, srv1510116449=29, srv1289562768=19, srv2059019684=57, srv642310736=85, srv594027719=80, srv1648354173=34, srv494114781=75, srv770215638=92, srv1732076536=39, srv1380715261=24, srv652927051=88, srv623059396=83, srv1909383288=50, srv509560829=76, srv112948322=7, srv2127393440=64, srv1447140495=25, srv2100617405=61, srv128322507=17, srv174278465=40, srv1041357564=2, srv756471940=91, srv811742328=94, srv1094230648=4, srv1656071318=35, srv1023723496=1, srv1695085489=37, srv600384574=81, srv798002778=93, srv1123602451=6, srv16949765=36, srv1714544882=38, srv1475201565=28, srv1778656742=42, srv1611962409=33, srv576248034=77, srv1862430016=46, srv1871782204=47, srv1792199734=44, srv348257152=69, srv593260624=79, srv1896867016=48, srv1224560606=13, srv2125371490=63, srv1819135367=45, srv485937575=74, srv1214697349=12, srv456449065=71, srv70580983=90, srv1905725860=49, srv1923031109=52, srv422659679=70, srv921614329=96, srv1598238466=32, srv1452979885=27, srv176248421=41, srv1226867592=14, srv1451069172=26, srv305431329=68, srv128820199=18, srv966548994=99, srv1110680080=5, srv932518714=97, srv1140766262=8, srv663622897=89, srv198688113=55, srv58574883=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:20,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 08:53:20,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 08:53:20,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 08:53:20,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 08:53:20,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 08:53:20,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 08:53:20,369 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:20,370 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1516425216:83 , srv1695085489:83 , srv2127393440:83 , srv348257152:83 , srv484304855:83 , srv600384574:83 , srv811742328:83 , srv932518714:83 , srv1023723496:84 , srv1041357564:84 , srv1060225203:84 , srv1094230648:84 , srv1110680080:84 , srv1123602451:84 , srv112948322:84 , srv1167556288:84 , srv1198849777:84 , srv1207806720:84 , srv1214697349:84 , srv1224560606:84 , srv1226867592:84 , srv1247136740:84 , srv1280186519:84 , srv128820199:84 , srv1289562768:84 , srv1290604290:84 , srv1296638340:84 , srv1322776831:84 , srv1339417878:84 , srv1380715261:84 , srv1447140495:84 , srv1451069172:84 , srv1452979885:84 , srv1475201565:84 , srv1510116449:84 , srv1515460436:84 , srv1598238466:84 , srv1611962409:84 , srv1648354173:84 , srv1714544882:84 , srv1732076536:84 , srv176248421:84 , srv1778656742:84 , srv178757436:84 , srv1792199734:84 , srv1819135367:84 , srv1862430016:84 , srv1871782204:84 , srv1905725860:84 , srv1909383288:84 , srv1922931356:84 , srv1923031109:84 , srv1933853166:84 , srv19509307:84 , srv198688113:84 , srv2015365491:84 , srv2059019684:84 , srv20747779:84 , srv2081079716:84 , srv2097443819:84 , srv2100617405:84 , srv2108197405:84 , srv2125371490:84 , srv2146117287:84 , srv228647387:84 , srv232392042:84 , srv305431329:84 , srv422659679:84 , srv456449065:84 , srv470103809:84 , srv485937575:84 , srv494114781:84 , srv509560829:84 , srv576248034:84 , srv58574883:84 , srv593260624:84 , srv594027719:84 , srv606296399:84 , srv623059396:84 , srv628700221:84 , srv642310736:84 , srv649165414:84 , srv652291871:84 , srv652927051:84 , srv663622897:84 , srv756471940:84 , srv798002778:84 , srv921307494:84 , srv921614329:84 , srv939447206:84 , srv966548994:84 , srv1009183660:85 , srv1140766262:85 , srv128322507:85 , srv1656071318:85 , srv174278465:85 , srv1896867016:85 , srv70580983:85 , srv770215638:85 , srv16949765:684 }
2023-12-26 08:53:20,403 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 353), ProcessCount=169 (was 169), AvailableMemoryMB=11195 (was 11802)
2023-12-26 08:53:20,410 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=169, AvailableMemoryMB=11195
2023-12-26 08:53:20,411 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 08:53:20,411 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-26 08:53:20,425 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011345848:84 , srv121288739:84 , srv1284910401:84 , srv1287630435:84 , srv1336295833:84 , srv1344159905:84 , srv1391966818:84 , srv164415414:84 , srv1698444533:84 , srv1725454510:84 , srv1797904137:84 , srv1903619787:84 , srv1907711429:84 , srv1975363965:84 , srv1988109438:84 , srv2053140274:84 , srv2126297889:84 , srv2133113547:84 , srv416680575:84 , srv434669712:84 , srv514059608:84 , srv528524409:84 , srv572404630:84 , srv587592712:84 , srv619359098:84 , srv668516560:84 , srv669839626:84 , srv880561482:84 , srv957925691:84 , srv766350223:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-26 08:53:20,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:53:20,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv528524409=21, srv434669712=19, srv416680575=18, srv619359098=24, srv1725454510=9, srv1336295833=4, srv1797904137=10, srv1903619787=11, srv1698444533=8, srv2053140274=15, srv2126297889=16, srv766350223=27, srv1284910401=2, srv1011345848=0, srv1344159905=5, srv1975363965=13, srv1988109438=14, srv669839626=26, srv514059608=20, srv121288739=1, srv587592712=23, srv1391966818=6, srv1907711429=12, srv1287630435=3, srv2133113547=17, srv572404630=22, srv668516560=25, srv880561482=28, srv164415414=7, srv957925691=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:53:20,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:53:20,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-26 08:53:20,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1308516846628862, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:53:20,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912605352649952, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1308516846628862, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-26 08:55:20,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6132012 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912605352649952 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:55:20,447 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011345848:90 , srv121288739:90 , srv1284910401:90 , srv1287630435:90 , srv1336295833:90 , srv1344159905:90 , srv1391966818:90 , srv164415414:90 , srv1698444533:90 , srv1725454510:90 , srv1797904137:90 , srv1903619787:90 , srv1907711429:90 , srv1975363965:90 , srv1988109438:90 , srv2053140274:90 , srv2126297889:90 , srv2133113547:90 , srv416680575:90 , srv434669712:90 , srv514059608:90 , srv528524409:90 , srv572404630:90 , srv587592712:90 , srv619359098:90 , srv668516560:90 , srv669839626:90 , srv766350223:90 , srv880561482:90 , srv957925691:90 }
2023-12-26 08:55:20,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 08:55:20,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv528524409=21, srv434669712=19, srv416680575=18, srv619359098=24, srv1725454510=9, srv1336295833=4, srv1797904137=10, srv1903619787=11, srv1698444533=8, srv2053140274=15, srv2126297889=16, srv766350223=27, srv1284910401=2, srv1011345848=0, srv1344159905=5, srv1975363965=13, srv1988109438=14, srv669839626=26, srv514059608=20, srv121288739=1, srv587592712=23, srv1391966818=6, srv1907711429=12, srv1287630435=3, srv2133113547=17, srv572404630=22, srv668516560=25, srv880561482=28, srv164415414=7, srv957925691=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 08:55:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 08:55:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 08:55:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-26 08:55:20,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 08:55:20,466 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1011345848:90 , srv121288739:90 , srv1284910401:90 , srv1287630435:90 , srv1336295833:90 , srv1344159905:90 , srv1391966818:90 , srv164415414:90 , srv1698444533:90 , srv1725454510:90 , srv1797904137:90 , srv1903619787:90 , srv1907711429:90 , srv1975363965:90 , srv1988109438:90 , srv2053140274:90 , srv2126297889:90 , srv2133113547:90 , srv416680575:90 , srv434669712:90 , srv514059608:90 , srv528524409:90 , srv572404630:90 , srv587592712:90 , srv619359098:90 , srv668516560:90 , srv669839626:90 , srv766350223:90 , srv880561482:90 , srv957925691:90 }
2023-12-26 08:55:20,481 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 353), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=11085 (was 11195)