2024-01-12 20:53:22,102 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-01-12 20:53:22,442 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-01-12 20:53:22,564 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-01-12 20:53:22,632 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 20:53:22,639 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-12 20:53:22,654 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=170, AvailableMemoryMB=13651
2024-01-12 20:53:22,656 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 20:53:22,657 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-01-12 20:53:22,784 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1008318797:84 , srv102243159:84 , srv1029371360:84 , srv1041140555:84 , srv1081325030:84 , srv1081893914:84 , srv1084002155:84 , srv1088650296:84 , srv108978415:84 , srv1102233090:84 , srv1136582813:84 , srv114520312:84 , srv1171865249:84 , srv1267786917:84 , srv1270407507:84 , srv1275444436:84 , srv1309830502:84 , srv1340452252:84 , srv1355836577:84 , srv1360077271:84 , srv1360613403:84 , srv1361821342:84 , srv1377772936:84 , srv1385490922:84 , srv1417097180:84 , srv1465333616:84 , srv1465484569:84 , srv1479667842:84 , srv1509844346:84 , srv1546194732:84 , srv1550505183:84 , srv1574040367:84 , srv1602787113:84 , srv1608964457:84 , srv1639958284:84 , srv1699564662:84 , srv1708502579:84 , srv1745047667:84 , srv1787967015:84 , srv1790574149:84 , srv181063133:84 , srv1813885887:84 , srv181438504:84 , srv1818324933:84 , srv1857735634:84 , srv18809043:84 , srv1911176380:84 , srv1947690776:84 , srv1953573597:84 , srv1971433729:84 , srv1985326479:84 , srv2005025346:84 , srv2008138809:84 , srv2085481762:84 , srv2099633221:84 , srv211618765:84 , srv2125447888:84 , srv2130873624:84 , srv2132712624:84 , srv233930207:84 , srv24619968:84 , srv271639530:84 , srv282254771:84 , srv299395318:84 , srv318909044:84 , srv32846465:84 , srv378795507:84 , srv390544140:84 , srv409529072:84 , srv432517051:84 , srv448859174:84 , srv452881667:84 , srv484480019:84 , srv497593133:84 , srv520162523:84 , srv550884204:84 , srv574033653:84 , srv621851487:84 , srv639055951:84 , srv640950710:84 , srv684211871:84 , srv742360939:84 , srv750826573:84 , srv761329959:84 , srv779162706:84 , srv794742364:84 , srv805023337:84 , srv833629953:84 , srv838864889:84 , srv84774877:84 , srv847829155:84 , srv900392692:84 , srv904753235:84 , srv909305725:84 , srv910837732:84 , srv954191669:84 , srv974213925:84 , srv991086705:84 , srv992331000:84 , srv1337148234:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-01-12 20:53:22,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:22,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv640950710=80, srv2008138809=53, srv1708502579=37, srv847829155=91, srv448859174=71, srv1340452252=18, srv1465484569=27, srv684211871=81, srv1171865249=12, srv1136582813=10, srv452881667=72, srv838864889=89, srv1574040367=32, srv390544140=68, srv1267786917=13, srv639055951=79, srv378795507=67, srv750826573=83, srv497593133=74, srv805023337=87, srv520162523=75, srv1102233090=9, srv1088650296=7, srv1787967015=39, srv1947690776=48, srv550884204=76, srv1385490922=24, srv909305725=94, srv32846465=66, srv1857735634=45, srv1360613403=21, srv299395318=64, srv574033653=77, srv1546194732=30, srv1745047667=38, srv18809043=46, srv102243159=1, srv1465333616=26, srv2005025346=52, srv181063133=41, srv1818324933=44, srv271639530=62, srv621851487=78, srv1081893914=5, srv1509844346=29, srv24619968=61, srv432517051=70, srv1355836577=19, srv181438504=43, srv900392692=92, srv1270407507=14, srv1911176380=47, srv211618765=56, srv904753235=93, srv1275444436=15, srv1699564662=36, srv484480019=73, srv409529072=69, srv761329959=84, srv1790574149=40, srv1639958284=35, srv1084002155=6, srv282254771=63, srv1971433729=50, srv233930207=60, srv1602787113=33, srv954191669=96, srv1953573597=49, srv1479667842=28, srv2125447888=57, srv2099633221=55, srv1029371360=2, srv779162706=85, srv1008318797=0, srv2132712624=59, srv1041140555=3, srv1337148234=17, srv114520312=11, srv910837732=95, srv1360077271=20, srv833629953=88, srv84774877=90, srv742360939=82, srv991086705=98, srv1417097180=25, srv974213925=97, srv1081325030=4, srv1377772936=23, srv1985326479=51, srv1361821342=22, srv1309830502=16, srv1608964457=34, srv318909044=65, srv108978415=8, srv992331000=99, srv1550505183=31, srv2085481762=54, srv1813885887=42, srv2130873624=58, srv794742364=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:22,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:22,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:22,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 20:53:22,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 20:53:22,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 20:53:22,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 20:53:22,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 20:53:22,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 20:53:22,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 20:53:22,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 20:53:22,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 20:53:22,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 20:53:22,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 20:53:23,065 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:23,065 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 20:53:23,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 20:53:23,511 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 589 ms to try 5000 different iterations.  Found a solution that moves 4683 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18126559976994877. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010057190758165, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05701910601875875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5203333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010057190758165, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24558333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:23,533 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1813885887:81 , srv2085481762:81 , srv2132712624:81 , srv520162523:81 , srv1479667842:82 , srv1947690776:82 , srv378795507:82 , srv1340452252:83 , srv1509844346:83 , srv1574040367:83 , srv2099633221:83 , srv233930207:83 , srv452881667:83 , srv805023337:83 , srv909305725:83 , srv1008318797:84 , srv1267786917:84 , srv1275444436:84 , srv1355836577:84 , srv1360077271:84 , srv1465484569:84 , srv1818324933:84 , srv18809043:84 , srv2130873624:84 , srv640950710:84 , srv742360939:84 , srv84774877:84 , srv1029371360:85 , srv1081893914:85 , srv1088650296:85 , srv1171865249:85 , srv1309830502:85 , srv1361821342:85 , srv1417097180:85 , srv1699564662:85 , srv1790574149:85 , srv181438504:85 , srv282254771:85 , srv318909044:85 , srv32846465:85 , srv992331000:85 , srv1081325030:86 , srv1102233090:86 , srv1136582813:86 , srv1270407507:86 , srv1550505183:86 , srv1639958284:86 , srv181063133:86 , srv1985326479:86 , srv2008138809:86 , srv211618765:86 , srv448859174:86 , srv761329959:86 , srv779162706:86 , srv794742364:86 , srv954191669:86 , srv974213925:86 , srv102243159:87 , srv1041140555:87 , srv1084002155:87 , srv1787967015:87 , srv1971433729:87 , srv2005025346:87 , srv2125447888:87 , srv271639530:87 , srv484480019:87 , srv550884204:87 , srv833629953:87 , srv847829155:87 , srv900392692:87 , srv991086705:87 , srv1360613403:88 , srv1385490922:88 , srv1602787113:88 , srv621851487:88 , srv639055951:88 , srv684211871:88 , srv1608964457:89 , srv1857735634:89 , srv1911176380:89 , srv1953573597:89 , srv409529072:89 , srv497593133:89 , srv750826573:89 , srv838864889:89 , srv114520312:90 , srv1377772936:90 , srv24619968:90 , srv390544140:90 , srv1465333616:91 , srv1708502579:91 , srv1745047667:91 , srv574033653:91 , srv299395318:92 , srv904753235:93 , srv1546194732:94 , srv910837732:94 , srv108978415:95 , srv432517051:96 , srv1337148234:446 }
2024-01-12 20:53:23,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:23,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv640950710=80, srv2008138809=53, srv1708502579=37, srv847829155=91, srv448859174=71, srv1340452252=18, srv1465484569=27, srv684211871=81, srv1171865249=12, srv1136582813=10, srv452881667=72, srv838864889=89, srv1574040367=32, srv390544140=68, srv1267786917=13, srv639055951=79, srv378795507=67, srv750826573=83, srv497593133=74, srv805023337=87, srv520162523=75, srv1102233090=9, srv1088650296=7, srv1787967015=39, srv1947690776=48, srv550884204=76, srv1385490922=24, srv909305725=94, srv32846465=66, srv1857735634=45, srv1360613403=21, srv299395318=64, srv574033653=77, srv1546194732=30, srv1745047667=38, srv18809043=46, srv102243159=1, srv1465333616=26, srv2005025346=52, srv181063133=41, srv1818324933=44, srv271639530=62, srv621851487=78, srv1081893914=5, srv1509844346=29, srv24619968=61, srv432517051=70, srv1355836577=19, srv181438504=43, srv900392692=92, srv1270407507=14, srv1911176380=47, srv211618765=56, srv904753235=93, srv1275444436=15, srv1699564662=36, srv484480019=73, srv409529072=69, srv761329959=84, srv1790574149=40, srv1639958284=35, srv1084002155=6, srv282254771=63, srv1971433729=50, srv233930207=60, srv1602787113=33, srv954191669=96, srv1953573597=49, srv1479667842=28, srv2125447888=57, srv2099633221=55, srv1029371360=2, srv779162706=85, srv1008318797=0, srv2132712624=59, srv1041140555=3, srv1337148234=17, srv114520312=11, srv910837732=95, srv1360077271=20, srv833629953=88, srv84774877=90, srv742360939=82, srv991086705=98, srv1417097180=25, srv974213925=97, srv1081325030=4, srv1377772936=23, srv1985326479=51, srv1361821342=22, srv1309830502=16, srv1608964457=34, srv318909044=65, srv108978415=8, srv992331000=99, srv1550505183=31, srv2085481762=54, srv1813885887=42, srv2130873624=58, srv794742364=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:23,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:23,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:23,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:23,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:23,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 20:53:23,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 20:53:23,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 20:53:23,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 20:53:23,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 20:53:23,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 20:53:23,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 20:53:23,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 20:53:23,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 20:53:23,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 20:53:23,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 20:53:23,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 20:53:23,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 20:53:23,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 20:53:23,754 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010057190758165, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05701910601875875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010057190758165, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24558333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:23,755 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 20:53:23,755 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18123280870309125, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04010057190758165, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05701910601875875, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04010057190758165, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17625, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24558333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 20:53:24,060 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 450 ms to try 5000 different iterations.  Found a solution that moves 2679 regions; Going from a computed imbalance of 0.18123280870309125 to a new imbalance of 0.015888545874458225. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02251047614670036); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331171440507566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2976666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02251047614670036); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:24,070 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv432517051:76 , srv108978415:78 , srv910837732:79 , srv1546194732:80 , srv1465333616:81 , srv1608964457:81 , srv1745047667:81 , srv1953573597:81 , srv24619968:81 , srv299395318:81 , srv114520312:82 , srv1377772936:82 , srv1385490922:82 , srv1911176380:82 , srv390544140:82 , srv574033653:82 , srv750826573:82 , srv1360613403:83 , srv1550505183:83 , srv1708502579:83 , srv1787967015:83 , srv1971433729:83 , srv2125447888:83 , srv409529072:83 , srv684211871:83 , srv838864889:83 , srv904753235:83 , srv102243159:84 , srv1041140555:84 , srv1084002155:84 , srv181063133:84 , srv1857735634:84 , srv2005025346:84 , srv497593133:84 , srv639055951:84 , srv847829155:84 , srv954191669:84 , srv1081325030:85 , srv1088650296:85 , srv1361821342:85 , srv1417097180:85 , srv1602787113:85 , srv181438504:85 , srv271639530:85 , srv621851487:85 , srv833629953:85 , srv900392692:85 , srv974213925:85 , srv991086705:85 , srv1102233090:86 , srv1136582813:86 , srv1309830502:86 , srv1639958284:86 , srv1699564662:86 , srv1790574149:86 , srv1818324933:86 , srv18809043:86 , srv1985326479:86 , srv2099633221:86 , srv211618765:86 , srv761329959:86 , srv992331000:86 , srv1171865249:87 , srv1270407507:87 , srv1340452252:87 , srv1355836577:87 , srv2008138809:87 , srv32846465:87 , srv484480019:87 , srv550884204:87 , srv640950710:87 , srv779162706:87 , srv84774877:87 , srv1008318797:88 , srv1029371360:88 , srv318909044:88 , srv378795507:88 , srv448859174:88 , srv742360939:88 , srv794742364:88 , srv1081893914:89 , srv1267786917:89 , srv1479667842:89 , srv1509844346:89 , srv1574040367:89 , srv2130873624:89 , srv282254771:89 , srv805023337:89 , srv909305725:89 , srv2085481762:90 , srv452881667:90 , srv1275444436:91 , srv1360077271:91 , srv233930207:91 , srv1465484569:92 , srv1947690776:92 , srv520162523:92 , srv1813885887:93 , srv2132712624:95 , srv1337148234:528 }
2024-01-12 20:53:24,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:24,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv640950710=80, srv2008138809=53, srv1708502579=37, srv847829155=91, srv448859174=71, srv1340452252=18, srv1465484569=27, srv684211871=81, srv1171865249=12, srv1136582813=10, srv452881667=72, srv838864889=89, srv1574040367=32, srv390544140=68, srv1267786917=13, srv639055951=79, srv378795507=67, srv750826573=83, srv497593133=74, srv805023337=87, srv520162523=75, srv1102233090=9, srv1088650296=7, srv1787967015=39, srv1947690776=48, srv550884204=76, srv1385490922=24, srv909305725=94, srv32846465=66, srv1857735634=45, srv1360613403=21, srv299395318=64, srv574033653=77, srv1546194732=30, srv1745047667=38, srv18809043=46, srv102243159=1, srv1465333616=26, srv2005025346=52, srv181063133=41, srv1818324933=44, srv271639530=62, srv621851487=78, srv1081893914=5, srv1509844346=29, srv24619968=61, srv432517051=70, srv1355836577=19, srv181438504=43, srv900392692=92, srv1270407507=14, srv1911176380=47, srv211618765=56, srv904753235=93, srv1275444436=15, srv1699564662=36, srv484480019=73, srv409529072=69, srv761329959=84, srv1790574149=40, srv1639958284=35, srv1084002155=6, srv282254771=63, srv1971433729=50, srv233930207=60, srv1602787113=33, srv954191669=96, srv1953573597=49, srv1479667842=28, srv2125447888=57, srv2099633221=55, srv1029371360=2, srv779162706=85, srv1008318797=0, srv2132712624=59, srv1041140555=3, srv1337148234=17, srv114520312=11, srv910837732=95, srv1360077271=20, srv833629953=88, srv84774877=90, srv742360939=82, srv991086705=98, srv1417097180=25, srv974213925=97, srv1081325030=4, srv1377772936=23, srv1985326479=51, srv1361821342=22, srv1309830502=16, srv1608964457=34, srv318909044=65, srv108978415=8, srv992331000=99, srv1550505183=31, srv2085481762=54, srv1813885887=42, srv2130873624=58, srv794742364=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:24,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:24,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:24,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:24,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:24,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:24,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:24,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 20:53:24,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 20:53:24,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 20:53:24,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 20:53:24,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 20:53:24,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 20:53:24,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 20:53:24,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 20:53:24,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 20:53:24,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 20:53:24,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 20:53:24,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02251047614670036); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331171440507566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02251047614670036); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:24,242 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 20:53:24,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015869787115519233, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02251047614670036); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0331171440507566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02251047614670036); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 20:53:24,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 369 ms to try 5000 different iterations.  Found a solution that moves 968 regions; Going from a computed imbalance of 0.015869787115519233 to a new imbalance of 6.098424846669501E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007446027270295804); MoveCostFunction : (multiplier=7.0, imbalance=0.10755555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:24,505 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1360077271:81 , srv904753235:81 , srv1275444436:82 , srv2132712624:82 , srv1081893914:83 , srv1465484569:83 , srv1708502579:83 , srv1813885887:83 , srv233930207:83 , srv448859174:83 , srv484480019:83 , srv1029371360:84 , srv1267786917:84 , srv1270407507:84 , srv1546194732:84 , srv1602787113:84 , srv1947690776:84 , srv282254771:84 , srv299395318:84 , srv452881667:84 , srv497593133:84 , srv550884204:84 , srv621851487:84 , srv779162706:84 , srv794742364:84 , srv909305725:84 , srv108978415:85 , srv1102233090:85 , srv114520312:85 , srv1171865249:85 , srv1309830502:85 , srv1465333616:85 , srv1509844346:85 , srv1857735634:85 , srv1985326479:85 , srv2008138809:85 , srv211618765:85 , srv2130873624:85 , srv318909044:85 , srv32846465:85 , srv390544140:85 , srv432517051:85 , srv520162523:85 , srv574033653:85 , srv639055951:85 , srv742360939:85 , srv761329959:85 , srv805023337:85 , srv910837732:85 , srv974213925:85 , srv1008318797:86 , srv1041140555:86 , srv1081325030:86 , srv1136582813:86 , srv1360613403:86 , srv1377772936:86 , srv1574040367:86 , srv1639958284:86 , srv1745047667:86 , srv1911176380:86 , srv2085481762:86 , srv24619968:86 , srv271639530:86 , srv409529072:86 , srv684211871:86 , srv750826573:86 , srv838864889:86 , srv84774877:86 , srv900392692:86 , srv992331000:86 , srv102243159:87 , srv1084002155:87 , srv1355836577:87 , srv1385490922:87 , srv1417097180:87 , srv1479667842:87 , srv1699564662:87 , srv1787967015:87 , srv1790574149:87 , srv181063133:87 , srv1818324933:87 , srv1953573597:87 , srv2005025346:87 , srv378795507:87 , srv640950710:87 , srv833629953:87 , srv847829155:87 , srv991086705:87 , srv1088650296:88 , srv1340452252:88 , srv1361821342:88 , srv1608964457:88 , srv181438504:88 , srv18809043:88 , srv1971433729:88 , srv2099633221:88 , srv2125447888:88 , srv954191669:88 , srv1550505183:89 , srv1337148234:538 }
2024-01-12 20:53:24,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:24,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv640950710=80, srv2008138809=53, srv1708502579=37, srv847829155=91, srv448859174=71, srv1340452252=18, srv1465484569=27, srv684211871=81, srv1171865249=12, srv1136582813=10, srv452881667=72, srv838864889=89, srv1574040367=32, srv390544140=68, srv1267786917=13, srv639055951=79, srv378795507=67, srv750826573=83, srv497593133=74, srv805023337=87, srv520162523=75, srv1102233090=9, srv1088650296=7, srv1787967015=39, srv1947690776=48, srv550884204=76, srv1385490922=24, srv909305725=94, srv32846465=66, srv1857735634=45, srv1360613403=21, srv299395318=64, srv574033653=77, srv1546194732=30, srv1745047667=38, srv18809043=46, srv102243159=1, srv1465333616=26, srv2005025346=52, srv181063133=41, srv1818324933=44, srv271639530=62, srv621851487=78, srv1081893914=5, srv1509844346=29, srv24619968=61, srv432517051=70, srv1355836577=19, srv181438504=43, srv900392692=92, srv1270407507=14, srv1911176380=47, srv211618765=56, srv904753235=93, srv1275444436=15, srv1699564662=36, srv484480019=73, srv409529072=69, srv761329959=84, srv1790574149=40, srv1639958284=35, srv1084002155=6, srv282254771=63, srv1971433729=50, srv233930207=60, srv1602787113=33, srv954191669=96, srv1953573597=49, srv1479667842=28, srv2125447888=57, srv2099633221=55, srv1029371360=2, srv779162706=85, srv1008318797=0, srv2132712624=59, srv1041140555=3, srv1337148234=17, srv114520312=11, srv910837732=95, srv1360077271=20, srv833629953=88, srv84774877=90, srv742360939=82, srv991086705=98, srv1417097180=25, srv974213925=97, srv1081325030=4, srv1377772936=23, srv1985326479=51, srv1361821342=22, srv1309830502=16, srv1608964457=34, srv318909044=65, srv108978415=8, srv992331000=99, srv1550505183=31, srv2085481762=54, srv1813885887=42, srv2130873624=58, srv794742364=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:24,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:24,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:24,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:24,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:24,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 20:53:24,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 20:53:24,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 20:53:24,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 20:53:24,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 20:53:24,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 20:53:24,640 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007446027270295804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:24,640 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-01-12 20:53:24,641 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.030644037961228E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007446027270295804); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-01-12 20:53:24,999 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 458 ms to try 5000 different iterations.  Found a solution that moves 231 regions; Going from a computed imbalance of 6.030644037961228E-4 to a new imbalance of 1.2186913496446338E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.025666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:24,999 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1465484569:83 , srv1574040367:83 , srv833629953:83 , srv991086705:83 , srv1008318797:84 , srv102243159:84 , srv1084002155:84 , srv1088650296:84 , srv108978415:84 , srv1136582813:84 , srv1340452252:84 , srv1355836577:84 , srv1377772936:84 , srv1479667842:84 , srv1509844346:84 , srv1546194732:84 , srv1550505183:84 , srv1608964457:84 , srv1639958284:84 , srv1699564662:84 , srv1745047667:84 , srv1790574149:84 , srv181438504:84 , srv1857735634:84 , srv18809043:84 , srv1947690776:84 , srv1971433729:84 , srv2005025346:84 , srv2008138809:84 , srv2125447888:84 , srv2130873624:84 , srv2132712624:84 , srv271639530:84 , srv282254771:84 , srv318909044:84 , srv409529072:84 , srv520162523:84 , srv550884204:84 , srv574033653:84 , srv640950710:84 , srv838864889:84 , srv847829155:84 , srv900392692:84 , srv904753235:84 , srv910837732:84 , srv954191669:84 , srv1029371360:85 , srv1041140555:85 , srv1081325030:85 , srv1081893914:85 , srv1102233090:85 , srv1171865249:85 , srv1267786917:85 , srv1270407507:85 , srv1275444436:85 , srv1360077271:85 , srv1360613403:85 , srv1361821342:85 , srv1385490922:85 , srv1417097180:85 , srv1465333616:85 , srv1602787113:85 , srv1708502579:85 , srv1787967015:85 , srv181063133:85 , srv1813885887:85 , srv1818324933:85 , srv1911176380:85 , srv1953573597:85 , srv1985326479:85 , srv2085481762:85 , srv211618765:85 , srv233930207:85 , srv24619968:85 , srv299395318:85 , srv32846465:85 , srv378795507:85 , srv390544140:85 , srv432517051:85 , srv448859174:85 , srv452881667:85 , srv484480019:85 , srv497593133:85 , srv621851487:85 , srv639055951:85 , srv684211871:85 , srv742360939:85 , srv750826573:85 , srv761329959:85 , srv779162706:85 , srv794742364:85 , srv805023337:85 , srv84774877:85 , srv992331000:85 , srv114520312:86 , srv1309830502:86 , srv2099633221:86 , srv909305725:86 , srv974213925:86 , srv1337148234:630 }
2024-01-12 20:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv640950710=80, srv2008138809=53, srv1708502579=37, srv847829155=91, srv448859174=71, srv1340452252=18, srv1465484569=27, srv684211871=81, srv1171865249=12, srv1136582813=10, srv452881667=72, srv838864889=89, srv1574040367=32, srv390544140=68, srv1267786917=13, srv639055951=79, srv378795507=67, srv750826573=83, srv497593133=74, srv805023337=87, srv520162523=75, srv1102233090=9, srv1088650296=7, srv1787967015=39, srv1947690776=48, srv550884204=76, srv1385490922=24, srv909305725=94, srv32846465=66, srv1857735634=45, srv1360613403=21, srv299395318=64, srv574033653=77, srv1546194732=30, srv1745047667=38, srv18809043=46, srv102243159=1, srv1465333616=26, srv2005025346=52, srv181063133=41, srv1818324933=44, srv271639530=62, srv621851487=78, srv1081893914=5, srv1509844346=29, srv24619968=61, srv432517051=70, srv1355836577=19, srv181438504=43, srv900392692=92, srv1270407507=14, srv1911176380=47, srv211618765=56, srv904753235=93, srv1275444436=15, srv1699564662=36, srv484480019=73, srv409529072=69, srv761329959=84, srv1790574149=40, srv1639958284=35, srv1084002155=6, srv282254771=63, srv1971433729=50, srv233930207=60, srv1602787113=33, srv954191669=96, srv1953573597=49, srv1479667842=28, srv2125447888=57, srv2099633221=55, srv1029371360=2, srv779162706=85, srv1008318797=0, srv2132712624=59, srv1041140555=3, srv1337148234=17, srv114520312=11, srv910837732=95, srv1360077271=20, srv833629953=88, srv84774877=90, srv742360939=82, srv991086705=98, srv1417097180=25, srv974213925=97, srv1081325030=4, srv1377772936=23, srv1985326479=51, srv1361821342=22, srv1309830502=16, srv1608964457=34, srv318909044=65, srv108978415=8, srv992331000=99, srv1550505183=31, srv2085481762=54, srv1813885887=42, srv2130873624=58, srv794742364=86} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:25,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:25,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-01-12 20:53:25,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-01-12 20:53:25,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-01-12 20:53:25,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-01-12 20:53:25,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-01-12 20:53:25,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-01-12 20:53:25,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-01-12 20:53:25,139 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.0569416924998904E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:25,139 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1465484569:83 , srv1574040367:83 , srv833629953:83 , srv991086705:83 , srv1008318797:84 , srv102243159:84 , srv1084002155:84 , srv1088650296:84 , srv108978415:84 , srv1136582813:84 , srv1340452252:84 , srv1355836577:84 , srv1377772936:84 , srv1479667842:84 , srv1509844346:84 , srv1546194732:84 , srv1550505183:84 , srv1608964457:84 , srv1639958284:84 , srv1699564662:84 , srv1745047667:84 , srv1790574149:84 , srv181438504:84 , srv1857735634:84 , srv18809043:84 , srv1947690776:84 , srv1971433729:84 , srv2005025346:84 , srv2008138809:84 , srv2125447888:84 , srv2130873624:84 , srv2132712624:84 , srv271639530:84 , srv282254771:84 , srv318909044:84 , srv409529072:84 , srv520162523:84 , srv550884204:84 , srv574033653:84 , srv640950710:84 , srv838864889:84 , srv847829155:84 , srv900392692:84 , srv904753235:84 , srv910837732:84 , srv954191669:84 , srv1029371360:85 , srv1041140555:85 , srv1081325030:85 , srv1081893914:85 , srv1102233090:85 , srv1171865249:85 , srv1267786917:85 , srv1270407507:85 , srv1275444436:85 , srv1360077271:85 , srv1360613403:85 , srv1361821342:85 , srv1385490922:85 , srv1417097180:85 , srv1465333616:85 , srv1602787113:85 , srv1708502579:85 , srv1787967015:85 , srv181063133:85 , srv1813885887:85 , srv1818324933:85 , srv1911176380:85 , srv1953573597:85 , srv1985326479:85 , srv2085481762:85 , srv211618765:85 , srv233930207:85 , srv24619968:85 , srv299395318:85 , srv32846465:85 , srv378795507:85 , srv390544140:85 , srv432517051:85 , srv448859174:85 , srv452881667:85 , srv484480019:85 , srv497593133:85 , srv621851487:85 , srv639055951:85 , srv684211871:85 , srv742360939:85 , srv750826573:85 , srv761329959:85 , srv779162706:85 , srv794742364:85 , srv805023337:85 , srv84774877:85 , srv992331000:85 , srv114520312:86 , srv1309830502:86 , srv2099633221:86 , srv909305725:86 , srv974213925:86 , srv1337148234:630 }
2024-01-12 20:53:25,172 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 250), ProcessCount=170 (was 170), AvailableMemoryMB=13050 (was 13651)
2024-01-12 20:53:25,182 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=170, AvailableMemoryMB=13050
2024-01-12 20:53:25,183 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-01-12 20:53:25,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-01-12 20:53:25,199 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1136039101:84 , srv1239920626:84 , srv1246658422:84 , srv1301619481:84 , srv13283518:84 , srv1358812499:84 , srv1379753276:84 , srv142866849:84 , srv1642978791:84 , srv1646239032:84 , srv1721042538:84 , srv1778935556:84 , srv1902628992:84 , srv1924080349:84 , srv1984115467:84 , srv2029846748:84 , srv234748150:84 , srv241071011:84 , srv253831056:84 , srv380676254:84 , srv381454225:84 , srv479933188:84 , srv660793619:84 , srv785761623:84 , srv813382658:84 , srv823731142:84 , srv900522565:84 , srv977923106:84 , srv997086846:84 , srv437380480:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-01-12 20:53:25,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:53:25,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv479933188=22, srv1379753276=6, srv1721042538=10, srv1984115467=14, srv437380480=21, srv823731142=26, srv977923106=28, srv1246658422=2, srv1778935556=11, srv13283518=4, srv1136039101=0, srv997086846=29, srv234748150=16, srv380676254=19, srv381454225=20, srv1301619481=3, srv660793619=23, srv1239920626=1, srv900522565=27, srv1902628992=12, srv785761623=24, srv813382658=25, srv2029846748=15, srv241071011=17, srv1358812499=5, srv1924080349=13, srv142866849=7, srv1642978791=8, srv253831056=18, srv1646239032=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:53:25,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:53:25,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:53:25,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-12 20:53:25,232 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1286302321381816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:53:25,233 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912598352925582, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1286302321381816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-01-12 20:55:25,219 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5503119 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912598352925582 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:55:25,226 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1136039101:90 , srv1239920626:90 , srv1246658422:90 , srv1301619481:90 , srv13283518:90 , srv1358812499:90 , srv1379753276:90 , srv142866849:90 , srv1642978791:90 , srv1646239032:90 , srv1721042538:90 , srv1778935556:90 , srv1902628992:90 , srv1924080349:90 , srv1984115467:90 , srv2029846748:90 , srv234748150:90 , srv241071011:90 , srv253831056:90 , srv380676254:90 , srv381454225:90 , srv437380480:90 , srv479933188:90 , srv660793619:90 , srv785761623:90 , srv813382658:90 , srv823731142:90 , srv900522565:90 , srv977923106:90 , srv997086846:90 }
2024-01-12 20:55:25,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-01-12 20:55:25,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv479933188=22, srv1379753276=6, srv1721042538=10, srv1984115467=14, srv437380480=21, srv823731142=26, srv977923106=28, srv1246658422=2, srv1778935556=11, srv13283518=4, srv1136039101=0, srv997086846=29, srv234748150=16, srv380676254=19, srv381454225=20, srv1301619481=3, srv660793619=23, srv1239920626=1, srv900522565=27, srv1902628992=12, srv785761623=24, srv813382658=25, srv2029846748=15, srv241071011=17, srv1358812499=5, srv1924080349=13, srv142866849=7, srv1642978791=8, srv253831056=18, srv1646239032=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-01-12 20:55:25,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-01-12 20:55:25,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-01-12 20:55:25,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-01-12 20:55:25,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-01-12 20:55:25,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-01-12 20:55:25,250 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1136039101:90 , srv1239920626:90 , srv1246658422:90 , srv1301619481:90 , srv13283518:90 , srv1358812499:90 , srv1379753276:90 , srv142866849:90 , srv1642978791:90 , srv1646239032:90 , srv1721042538:90 , srv1778935556:90 , srv1902628992:90 , srv1924080349:90 , srv1984115467:90 , srv2029846748:90 , srv234748150:90 , srv241071011:90 , srv253831056:90 , srv380676254:90 , srv381454225:90 , srv437380480:90 , srv479933188:90 , srv660793619:90 , srv785761623:90 , srv813382658:90 , srv823731142:90 , srv900522565:90 , srv977923106:90 , srv997086846:90 }
2024-01-12 20:55:25,263 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 250), ProcessCount=167 (was 170), AvailableMemoryMB=12270 (was 13050)