org.apache.flink.connectors.hive.read

Class HiveSourceSplit

java.lang.Object

org.apache.flink.connector.file.src.FileSourceSplit

org.apache.flink.connectors.hive.read.HiveSourceSplit

All Implemented Interfaces:

Serializable, SourceSplit

@PublicEvolving
public class HiveSourceSplit
extends FileSourceSplit

A sub-class of FileSourceSplit that contains extra information needed to read a hive table.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveSourceSplit(org.apache.hadoop.mapred.FileSplit fileSplit, HiveTablePartition hiveTablePartition, CheckpointedPosition readerPosition)
HiveSourceSplit(String id, Path filePath, long offset, long length, long fileModificationTime, long fileSize, String[] hostnames, CheckpointedPosition readerPosition, HiveTablePartition hiveTablePartition)
HiveSourceSplit(String id, Path filePath, long offset, long length, String[] hostnames, CheckpointedPosition readerPosition, HiveTablePartition hiveTablePartition) Deprecated. You should use HiveSourceSplit(String, Path, long, long, long, long, String[], CheckpointedPosition, HiveTablePartition)

Method Summary

Modifier and Type	Method and Description
HiveTablePartition	getHiveTablePartition()
org.apache.hadoop.mapred.FileSplit	toMapRedSplit()
String	toString()
FileSourceSplit	updateWithCheckpointedPosition(CheckpointedPosition position) Creates a copy of this split where the checkpointed position is replaced by the given new position.

Methods inherited from class org.apache.flink.connector.file.src.FileSourceSplit

fileModificationTime, fileSize, getReaderPosition, hostnames, length, offset, path, splitId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

HiveSourceSplit

public HiveSourceSplit(org.apache.hadoop.mapred.FileSplit fileSplit,
                       HiveTablePartition hiveTablePartition,
                       @Nullable
                       CheckpointedPosition readerPosition)
                throws IOException

Throws:

IOException

HiveSourceSplit

public HiveSourceSplit(String id,
                       Path filePath,
                       long offset,
                       long length,
                       long fileModificationTime,
                       long fileSize,
                       String[] hostnames,
                       @Nullable
                       CheckpointedPosition readerPosition,
                       HiveTablePartition hiveTablePartition)

HiveSourceSplit

@Deprecated
public HiveSourceSplit(String id,
                                   Path filePath,
                                   long offset,
                                   long length,
                                   String[] hostnames,
                                   @Nullable
                                   CheckpointedPosition readerPosition,
                                   HiveTablePartition hiveTablePartition)

Deprecated. You should use HiveSourceSplit(String, Path, long, long, long, long, String[], CheckpointedPosition, HiveTablePartition)

Method Detail

getHiveTablePartition

public HiveTablePartition getHiveTablePartition()

toMapRedSplit

public org.apache.hadoop.mapred.FileSplit toMapRedSplit()

updateWithCheckpointedPosition

public FileSourceSplit updateWithCheckpointedPosition(@Nullable
                                                      CheckpointedPosition position)

Description copied from class: FileSourceSplit

Creates a copy of this split where the checkpointed position is replaced by the given new position.

IMPORTANT: Subclasses that add additional information to the split must override this method to return that subclass type. This contract is enforced by checks in the file source implementation. We did not try to enforce this contract via generics in this split class, because it leads to very ugly and verbose use of generics.

Overrides:

updateWithCheckpointedPosition in class FileSourceSplit

toString

public String toString()

Overrides:

toString in class FileSourceSplit