org.apache.flink.connectors.hive.read

Class HiveContinuousPartitionFetcher<T extends Comparable<T>>

java.lang.Object

org.apache.flink.connectors.hive.read.HiveContinuousPartitionFetcher<T>

All Implemented Interfaces:

Serializable, ContinuousPartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition,T>, PartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition>

@Internal
public class HiveContinuousPartitionFetcher<T extends Comparable<T>>
extends Object
implements ContinuousPartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition,T>

A ContinuousPartitionFetcher for hive table.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.connector.file.table.ContinuousPartitionFetcher

ContinuousPartitionFetcher.Context<P,T extends Comparable<T>>

Constructor Summary

Constructors

Constructor and Description
HiveContinuousPartitionFetcher()

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.hive.metastore.api.Partition>	fetch(PartitionFetcher.Context<org.apache.hadoop.hive.metastore.api.Partition> context) Fetch the suitable partitions, call this method should guarantee the fetcher has opened.
List<Tuple2<org.apache.hadoop.hive.metastore.api.Partition,T>>	fetchPartitions(ContinuousPartitionFetcher.Context<org.apache.hadoop.hive.metastore.api.Partition,T> context, T previousOffset) Fetch partitions by previous partition offset (Including).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveContinuousPartitionFetcher

public HiveContinuousPartitionFetcher()

Method Detail

fetchPartitions

public List<Tuple2<org.apache.hadoop.hive.metastore.api.Partition,T>> fetchPartitions(ContinuousPartitionFetcher.Context<org.apache.hadoop.hive.metastore.api.Partition,T> context,
                                                                                      T previousOffset)
                                                                               throws Exception

Description copied from interface: ContinuousPartitionFetcher

Fetch partitions by previous partition offset (Including).

Specified by:

fetchPartitions in interface ContinuousPartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition,T extends Comparable<T>>

Throws:

Exception

fetch

public List<org.apache.hadoop.hive.metastore.api.Partition> fetch(PartitionFetcher.Context<org.apache.hadoop.hive.metastore.api.Partition> context)
                                                           throws Exception

Description copied from interface: PartitionFetcher

Fetch the suitable partitions, call this method should guarantee the fetcher has opened.

Specified by:

fetch in interface PartitionFetcher<org.apache.hadoop.hive.metastore.api.Partition>

Throws:

Exception