org.apache.flink.hcatalog.java

Class HCatInputFormat<T>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<T,HadoopInputSplit>

org.apache.flink.hcatalog.HCatInputFormatBase<T>

org.apache.flink.hcatalog.java.HCatInputFormat<T>

Type Parameters:

T -

All Implemented Interfaces:

Serializable, InputFormat<T,HadoopInputSplit>, ResultTypeQueryable<T>, InputSplitSource<HadoopInputSplit>

public class HCatInputFormat<T>
extends HCatInputFormatBase<T>

A InputFormat to read from HCatalog tables. The InputFormat supports projection (selection and order of fields) and partition filters.

Data can be returned as HCatRecord or Flink Tuple. Flink tuples support only up to 25 fields.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.hcatalog.HCatInputFormatBase

fieldNames, outputSchema

Constructor Summary

Constructors

Constructor and Description
HCatInputFormat()
HCatInputFormat(String database, String table)
HCatInputFormat(String database, String table, Configuration config)

Method Summary

Modifier and Type	Method and Description
protected T	buildFlinkTuple(T t, org.apache.hive.hcatalog.data.HCatRecord record)
protected int	getMaxFlinkTupleSize()

Methods inherited from class org.apache.flink.hcatalog.HCatInputFormatBase

asFlinkTuples, close, configure, createInputSplits, getConfiguration, getFields, getInputSplitAssigner, getOutputSchema, getProducedType, getStatistics, nextRecord, open, reachedEnd, withFilter

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatInputFormat

public HCatInputFormat()

HCatInputFormat

public HCatInputFormat(String database,
                       String table)
                throws Exception

Throws:

Exception

HCatInputFormat

public HCatInputFormat(String database,
                       String table,
                       Configuration config)
                throws Exception

Throws:

Exception

Method Detail

getMaxFlinkTupleSize

protected int getMaxFlinkTupleSize()

Specified by:

getMaxFlinkTupleSize in class HCatInputFormatBase<T>

buildFlinkTuple

protected T buildFlinkTuple(T t,
                            org.apache.hive.hcatalog.data.HCatRecord record)
                     throws org.apache.hive.hcatalog.common.HCatException

Specified by:

buildFlinkTuple in class HCatInputFormatBase<T>

Throws:

org.apache.hive.hcatalog.common.HCatException