org.apache.flink.table.catalog.hive.util

Class HiveStatsUtil

java.lang.Object

org.apache.flink.table.catalog.hive.util.HiveStatsUtil

public class HiveStatsUtil
extends Object

Utils for stats of HiveCatalog.

Method Summary

Modifier and Type	Method and Description
static Map<String,CatalogColumnStatisticsDataBase>	createCatalogColumnStats(List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> hiveColStats, String hiveVersion) Create a map of Flink column stats from the given Hive column stats.
static CatalogTableStatistics	createCatalogTableStatistics(Map<String,String> parameters)
static org.apache.hadoop.hive.metastore.api.ColumnStatistics	createPartitionColumnStats(org.apache.hadoop.hive.metastore.api.Partition hivePartition, String partName, Map<String,CatalogColumnStatisticsDataBase> colStats, String hiveVersion) Create columnStatistics from the given Hive column stats of a hive partition.
static org.apache.hadoop.hive.metastore.api.ColumnStatistics	createTableColumnStats(org.apache.hadoop.hive.metastore.api.Table hiveTable, Map<String,CatalogColumnStatisticsDataBase> colStats, String hiveVersion) Create columnStatistics from the given Hive column stats of a hive table.
static Map<String,CatalogColumnStatisticsDataBase>	getCatalogPartitionColumnStats(HiveMetastoreClientWrapper client, HiveShim hiveShim, org.apache.hadoop.hive.metastore.api.Table hiveTable, String partitionName, List<org.apache.hadoop.hive.metastore.api.FieldSchema> partitionColsSchema, String defaultPartitionName) Get column statistic for partition columns.
static int	parsePositiveIntStat(Map<String,String> parameters, String key)
static long	parsePositiveLongStat(Map<String,String> parameters, String key)
static boolean	statsChanged(CatalogTableStatistics newTableStats, Map<String,String> parameters) Determine whether the table statistics changes.
static boolean	tableStatsChanged(Map<String,String> newStats, Map<String,String> oldStats) Determine whether the stats change.
static void	updateStats(CatalogTableStatistics newTableStats, Map<String,String> parameters) Update original table statistics parameters.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createCatalogColumnStats

public static Map<String,CatalogColumnStatisticsDataBase> createCatalogColumnStats(@Nonnull
                                                                                   List<org.apache.hadoop.hive.metastore.api.ColumnStatisticsObj> hiveColStats,
                                                                                   String hiveVersion)

Create a map of Flink column stats from the given Hive column stats.

getCatalogPartitionColumnStats

public static Map<String,CatalogColumnStatisticsDataBase> getCatalogPartitionColumnStats(HiveMetastoreClientWrapper client,
                                                                                         HiveShim hiveShim,
                                                                                         org.apache.hadoop.hive.metastore.api.Table hiveTable,
                                                                                         String partitionName,
                                                                                         List<org.apache.hadoop.hive.metastore.api.FieldSchema> partitionColsSchema,
                                                                                         String defaultPartitionName)

Get column statistic for partition columns.

createCatalogTableStatistics

public static CatalogTableStatistics createCatalogTableStatistics(Map<String,String> parameters)

statsChanged

public static boolean statsChanged(CatalogTableStatistics newTableStats,
                                   Map<String,String> parameters)

Determine whether the table statistics changes.

Parameters:

newTableStats - new catalog table statistics.

parameters - original hive table statistics parameters.

Returns:

whether the table statistics changes

tableStatsChanged

public static boolean tableStatsChanged(Map<String,String> newStats,
                                        Map<String,String> oldStats)

Determine whether the stats change.

Parameters:

newStats - the new table statistics parameters

oldStats - the old table statistics parameters

Returns:

whether the stats change

createTableColumnStats

public static org.apache.hadoop.hive.metastore.api.ColumnStatistics createTableColumnStats(org.apache.hadoop.hive.metastore.api.Table hiveTable,
                                                                                           Map<String,CatalogColumnStatisticsDataBase> colStats,
                                                                                           String hiveVersion)

Create columnStatistics from the given Hive column stats of a hive table.

createPartitionColumnStats

public static org.apache.hadoop.hive.metastore.api.ColumnStatistics createPartitionColumnStats(org.apache.hadoop.hive.metastore.api.Partition hivePartition,
                                                                                               String partName,
                                                                                               Map<String,CatalogColumnStatisticsDataBase> colStats,
                                                                                               String hiveVersion)

Create columnStatistics from the given Hive column stats of a hive partition.

updateStats

public static void updateStats(CatalogTableStatistics newTableStats,
                               Map<String,String> parameters)

Update original table statistics parameters.

Parameters:

newTableStats - new catalog table statistics.

parameters - original hive table statistics parameters.

parsePositiveIntStat

public static int parsePositiveIntStat(Map<String,String> parameters,
                                       String key)

parsePositiveLongStat

public static long parsePositiveLongStat(Map<String,String> parameters,
                                         String key)