org.apache.flink.connectors.hive.read

Class HivePartitionFetcherContextBase<P>

java.lang.Object

org.apache.flink.connectors.hive.read.HivePartitionFetcherContextBase<P>

All Implemented Interfaces:

Serializable, PartitionFetcher.Context<P>, HivePartitionContext<P>

Direct Known Subclasses:

HiveTableSource.HiveContinuousPartitionFetcherContext

public abstract class HivePartitionFetcherContextBase<P>
extends Object
implements HivePartitionContext<P>

Base class for table partition fetcher context.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.connector.file.table.PartitionFetcher.Context

PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>>

Field Summary

Fields

Modifier and Type	Field and Description
protected Configuration	configuration
protected JobConfWrapper	confWrapper
protected String	defaultPartitionName
protected String[]	fieldNames
protected DataType[]	fieldTypes
protected HiveShim	hiveShim
protected HiveMetastoreClientWrapper	metaStoreClient
protected List<String>	partitionKeys
protected HiveOptions.PartitionOrder	partitionOrder
protected org.apache.hadoop.fs.Path	tableLocation
protected ObjectPath	tablePath
protected Properties	tableProps
protected org.apache.hadoop.hive.metastore.api.StorageDescriptor	tableSd

Constructor Summary

Constructors

Constructor and Description
HivePartitionFetcherContextBase(ObjectPath tablePath, HiveShim hiveShim, JobConfWrapper confWrapper, List<String> partitionKeys, DataType[] fieldTypes, String[] fieldNames, Configuration configuration, String defaultPartitionName)

Method Summary

Modifier and Type	Method and Description
void	close() close the resources of the Context, this method should call when the context do not need any more.
List<PartitionFetcher.Context.ComparablePartitionValue>	getComparablePartitionValueList() Get list that contains partition with comparable object.
void	open() open the resources of the Context, this method should first call before call other methods.
HiveTablePartition	toHiveTablePartition(P partition) Convert partition to HiveTablePartition.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.connector.file.table.PartitionFetcher.Context

getPartition

Field Detail

tablePath

protected final ObjectPath tablePath

hiveShim

protected final HiveShim hiveShim

confWrapper

protected final JobConfWrapper confWrapper

partitionKeys

protected final List<String> partitionKeys

fieldTypes

protected final DataType[] fieldTypes

fieldNames

protected final String[] fieldNames

configuration

protected final Configuration configuration

defaultPartitionName

protected final String defaultPartitionName

partitionOrder

protected final HiveOptions.PartitionOrder partitionOrder

metaStoreClient

protected transient HiveMetastoreClientWrapper metaStoreClient

tableSd

protected transient org.apache.hadoop.hive.metastore.api.StorageDescriptor tableSd

tableProps

protected transient Properties tableProps

tableLocation

protected transient org.apache.hadoop.fs.Path tableLocation

Constructor Detail

HivePartitionFetcherContextBase

public HivePartitionFetcherContextBase(ObjectPath tablePath,
                                       HiveShim hiveShim,
                                       JobConfWrapper confWrapper,
                                       List<String> partitionKeys,
                                       DataType[] fieldTypes,
                                       String[] fieldNames,
                                       Configuration configuration,
                                       String defaultPartitionName)

Method Detail

open

public void open()
          throws Exception

Description copied from interface: PartitionFetcher.Context

open the resources of the Context, this method should first call before call other methods.

Specified by:

open in interface PartitionFetcher.Context<P>

Throws:

Exception

getComparablePartitionValueList

public List<PartitionFetcher.Context.ComparablePartitionValue> getComparablePartitionValueList()
                                                                                        throws Exception

Description copied from interface: PartitionFetcher.Context

Get list that contains partition with comparable object.

For 'create-time' and 'partition-time',the comparable object type is Long which represents time in milliseconds, for 'partition-name', the comparable object type is String which represents the partition names string.

Specified by:

getComparablePartitionValueList in interface PartitionFetcher.Context<P>

Throws:

Exception

close

public void close()
           throws Exception

Description copied from interface: PartitionFetcher.Context

close the resources of the Context, this method should call when the context do not need any more.

Specified by:

close in interface PartitionFetcher.Context<P>

Throws:

Exception

toHiveTablePartition

public HiveTablePartition toHiveTablePartition(P partition)

Description copied from interface: HivePartitionContext

Convert partition to HiveTablePartition.

Specified by:

toHiveTablePartition in interface HivePartitionContext<P>