Modifier and Type | Field and Description |
---|---|
protected FileInputSplit |
FileInputFormat.currentSplit
The current split that this parallel instance must consume.
|
Modifier and Type | Method and Description |
---|---|
FileInputSplit[] |
BinaryInputFormat.createInputSplits(int minNumSplits) |
FileInputSplit[] |
FileInputFormat.createInputSplits(int minNumSplits)
Computes the input splits for the file.
|
protected FileInputSplit[] |
BinaryInputFormat.getInputSplits() |
Modifier and Type | Method and Description |
---|---|
protected FSDataInputStream |
FileInputFormat.decorateInputStream(FSDataInputStream inputStream,
FileInputSplit fileSplit)
This method allows to wrap/decorate the raw
FSDataInputStream for a certain file
split, e.g., for decoding. |
LocatableInputSplitAssigner |
FileInputFormat.getInputSplitAssigner(FileInputSplit[] splits) |
protected void |
GenericCsvInputFormat.initializeSplit(FileInputSplit split,
Long offset) |
protected void |
DelimitedInputFormat.initializeSplit(FileInputSplit split,
Long state)
Initialization method that is called after opening or reopening an input split.
|
void |
BinaryInputFormat.open(FileInputSplit split) |
void |
DelimitedInputFormat.open(FileInputSplit split)
Opens the given input split.
|
void |
FileInputFormat.open(FileInputSplit fileSplit)
Opens an input stream to the file defined in the input format.
|
void |
DelimitedInputFormat.reopen(FileInputSplit split,
Long state) |
void |
BinaryInputFormat.reopen(FileInputSplit split,
Tuple2<Long,Long> state) |
Constructor and Description |
---|
InputSplitOpenThread(FileInputSplit split,
long timeout) |
Modifier and Type | Method and Description |
---|---|
protected void |
CsvInputFormat.initializeSplit(FileInputSplit split,
Long offset) |
protected void |
PrimitiveInputFormat.initializeSplit(FileInputSplit split,
Long offset) |
void |
PojoCsvInputFormat.initializeSplit(FileInputSplit split,
Long offset) |
Modifier and Type | Method and Description |
---|---|
void |
HiveTableFileInputFormat.open(FileInputSplit fileSplit) |
Modifier and Type | Method and Description |
---|---|
void |
AvroInputFormat.open(FileInputSplit split) |
void |
AvroInputFormat.reopen(FileInputSplit split,
Tuple2<Long,Long> state) |
Modifier and Type | Method and Description |
---|---|
void |
AbstractCsvInputFormat.open(FileInputSplit split) |
void |
RowCsvInputFormat.open(FileInputSplit split) |
void |
CsvFileSystemFormatFactory.CsvInputFormat.open(FileInputSplit split) |
Modifier and Type | Method and Description |
---|---|
void |
ParquetInputFormat.open(FileInputSplit split) |
void |
ParquetPojoInputFormat.open(FileInputSplit split) |
void |
ParquetInputFormat.reopen(FileInputSplit split,
Tuple2<Long,Long> state) |
Modifier and Type | Method and Description |
---|---|
void |
OrcRowInputFormat.open(FileInputSplit fileSplit) |
Modifier and Type | Class and Description |
---|---|
class |
TimestampedFileInputSplit
A
FileInputSplit with TimestampedInputSplit . |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.