org.apache.flink.connectors.hive.read

Class HiveMapredSplitReader

java.lang.Object

org.apache.flink.connectors.hive.read.HiveMapredSplitReader

All Implemented Interfaces:

Closeable, AutoCloseable, SplitReader

public class HiveMapredSplitReader
extends Object
implements SplitReader

Hive SplitReader to read files using hadoop mapred RecordReader.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.io.Writable	key
protected org.apache.hadoop.io.Writable	value

Constructor Summary

Constructors

Constructor and Description
HiveMapredSplitReader(org.apache.hadoop.mapred.JobConf jobConf, List<String> partitionKeys, DataType[] fieldTypes, int[] selectedFields, HiveTableInputSplit split, HiveShim hiveShim)

Method Summary

Modifier and Type	Method and Description
void	close()
RowData	nextRecord(RowData reuse) Reads the next record from the input.
boolean	reachedEnd() Method used to check if the end of the input is reached.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.connectors.hive.read.SplitReader

seekToRow

Field Detail

key

protected org.apache.hadoop.io.Writable key

value

protected org.apache.hadoop.io.Writable value

Constructor Detail

HiveMapredSplitReader

public HiveMapredSplitReader(org.apache.hadoop.mapred.JobConf jobConf,
                             List<String> partitionKeys,
                             DataType[] fieldTypes,
                             int[] selectedFields,
                             HiveTableInputSplit split,
                             HiveShim hiveShim)
                      throws IOException

Throws:

IOException

Method Detail

reachedEnd

public boolean reachedEnd()
                   throws IOException

Description copied from interface: SplitReader

Method used to check if the end of the input is reached.

Specified by:

reachedEnd in interface SplitReader

Returns:

True if the end is reached, otherwise false.

Throws:

IOException - Thrown, if an I/O error occurred.

nextRecord

public RowData nextRecord(RowData reuse)
                   throws IOException

Description copied from interface: SplitReader

Reads the next record from the input.

Specified by:

nextRecord in interface SplitReader

Parameters:

reuse - Object that may be reused.

Returns:

Read record.

Throws:

IOException - Thrown, if an I/O error occurred.

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException