public class HiveInputFormat extends Object implements BulkFormat<RowData,HiveSourceSplit>
BulkFormat.Reader<T>, BulkFormat.RecordIterator<T>
Constructor and Description |
---|
HiveInputFormat(JobConfWrapper jobConfWrapper,
List<String> partitionKeys,
String[] fieldNames,
DataType[] fieldTypes,
String hiveVersion,
RowType producedRowType,
boolean useMapRedReader) |
Modifier and Type | Method and Description |
---|---|
BulkFormat.Reader<RowData> |
createReader(Configuration config,
HiveSourceSplit split)
Creates a new reader that reads from the
split's path starting
at the split's offset and reads length bytes after the offset. |
TypeInformation<RowData> |
getProducedType()
Gets the type produced by this format.
|
boolean |
isSplittable()
Checks whether this format is splittable.
|
BulkFormat.Reader<RowData> |
restoreReader(Configuration config,
HiveSourceSplit split)
Creates a new reader that reads from
split.path() starting at offset and
reads until length bytes after the offset. |
public BulkFormat.Reader<RowData> createReader(Configuration config, HiveSourceSplit split) throws IOException
BulkFormat
split's path
starting
at the split's offset
and reads length
bytes after the offset.createReader
in interface BulkFormat<RowData,HiveSourceSplit>
IOException
public BulkFormat.Reader<RowData> restoreReader(Configuration config, HiveSourceSplit split) throws IOException
BulkFormat
split.path()
starting at offset
and
reads until length
bytes after the offset. A number of recordsToSkip
records
should be read and discarded after the offset. This is typically part of restoring a reader
to a checkpointed position.restoreReader
in interface BulkFormat<RowData,HiveSourceSplit>
IOException
public boolean isSplittable()
BulkFormat
See top-level JavaDocs
(section "Splitting") for details.
isSplittable
in interface BulkFormat<RowData,HiveSourceSplit>
public TypeInformation<RowData> getProducedType()
BulkFormat
getProducedType
in interface ResultTypeQueryable<RowData>
getProducedType
in interface BulkFormat<RowData,HiveSourceSplit>
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.