Modifier and Type | Class and Description |
---|---|
class |
InputStreamFSInputWrapper
This class wraps an
InputStream and exposes it as FSDataInputStream . |
Modifier and Type | Field and Description |
---|---|
protected FSDataInputStream |
FileInputFormat.stream
The input stream reading from the input file.
|
Modifier and Type | Method and Description |
---|---|
protected FSDataInputStream |
FileInputFormat.decorateInputStream(FSDataInputStream inputStream,
FileInputSplit fileSplit)
This method allows to wrap/decorate the raw
FSDataInputStream for a certain file
split, e.g., for decoding. |
FSDataInputStream |
FileInputFormat.InputSplitOpenThread.waitForCompletion() |
Modifier and Type | Method and Description |
---|---|
protected FSDataInputStream |
FileInputFormat.decorateInputStream(FSDataInputStream inputStream,
FileInputSplit fileSplit)
This method allows to wrap/decorate the raw
FSDataInputStream for a certain file
split, e.g., for decoding. |
Constructor and Description |
---|
BlockBasedInput(FSDataInputStream in,
int blockSize) |
BlockBasedInput(FSDataInputStream in,
int startPos,
long length) |
Modifier and Type | Method and Description |
---|---|
abstract StreamFormat.Reader<T> |
SimpleStreamFormat.createReader(Configuration config,
FSDataInputStream stream)
Creates a new reader.
|
TextLineInputFormat.Reader |
TextLineInputFormat.createReader(Configuration config,
FSDataInputStream stream) |
StreamFormat.Reader<T> |
StreamFormat.createReader(Configuration config,
FSDataInputStream stream,
long fileLen,
long splitEnd)
Creates a new reader to read in this format.
|
StreamFormat.Reader<T> |
SimpleStreamFormat.createReader(Configuration config,
FSDataInputStream stream,
long fileLen,
long splitEnd) |
StreamFormat.Reader<T> |
StreamFormat.restoreReader(Configuration config,
FSDataInputStream stream,
long restoredOffset,
long fileLen,
long splitEnd)
Restores a reader from a checkpointed position.
|
StreamFormat.Reader<T> |
SimpleStreamFormat.restoreReader(Configuration config,
FSDataInputStream stream,
long restoredOffset,
long fileLen,
long splitEnd) |
Modifier and Type | Class and Description |
---|---|
class |
ClosingFSDataInputStream
This class is a
WrappingProxy for FSDataInputStream that is
used to implement a safety net against unclosed streams. |
class |
FSDataInputStreamWrapper
Simple forwarding wrapper around
FSDataInputStream . |
Modifier and Type | Field and Description |
---|---|
protected FSDataInputStream |
FSDataInputStreamWrapper.inputStream |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
FSDataInputStreamWrapper.getWrappedDelegate() |
FSDataInputStream |
LimitedConnectionsFileSystem.open(Path f) |
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f) |
abstract FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path.
|
FSDataInputStream |
LimitedConnectionsFileSystem.open(Path f,
int bufferSize) |
FSDataInputStream |
SafetyNetWrapperFileSystem.open(Path f,
int bufferSize) |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path.
|
Modifier and Type | Method and Description |
---|---|
static ClosingFSDataInputStream |
ClosingFSDataInputStream.wrapSafe(FSDataInputStream delegate,
SafetyNetCloseableRegistry registry) |
static ClosingFSDataInputStream |
ClosingFSDataInputStream.wrapSafe(FSDataInputStream delegate,
SafetyNetCloseableRegistry registry,
String debugInfo) |
Constructor and Description |
---|
FSDataInputStreamWrapper(FSDataInputStream inputStream) |
Modifier and Type | Class and Description |
---|---|
class |
LocalDataInputStream
The
LocalDataInputStream class is a wrapper class for a data input stream to the
local file system. |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
LocalFileSystem.open(Path f) |
FSDataInputStream |
LocalFileSystem.open(Path f,
int bufferSize) |
Constructor and Description |
---|
FSDataInputStreamWrapper(FSDataInputStream stream,
long len) |
Modifier and Type | Method and Description |
---|---|
StreamFormat.Reader<T> |
CsvReaderFormat.createReader(Configuration config,
FSDataInputStream stream) |
Constructor and Description |
---|
ParquetInputFile(FSDataInputStream inputStream,
long length) |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
SegmentFileStateHandle.openInputStream() |
Modifier and Type | Class and Description |
---|---|
class |
HadoopDataInputStream
Concrete implementation of the
FSDataInputStream for Hadoop's input streams. |
Modifier and Type | Class and Description |
---|---|
class |
CompressibleFSDataInputStream
FSDataInputStream that delegates all reading operations to a wrapping StreamCompressionDecorator . |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
KeyGroupsStateHandle.openInputStream() |
FSDataInputStream |
SharedStateRegistryImpl.EmptyDiscardStateObjectForRegister.openInputStream() |
FSDataInputStream |
OperatorStreamStateHandle.openInputStream() |
FSDataInputStream |
RetrievableStreamStateHandle.openInputStream() |
FSDataInputStream |
PlaceholderStreamStateHandle.openInputStream() |
FSDataInputStream |
StreamStateHandle.openInputStream()
Returns an
FSDataInputStream that can be used to read back the data that was
previously written to the stream. |
FSDataInputStream |
OperatorStateHandle.openInputStream()
Returns an input stream to read the operator state information.
|
Constructor and Description |
---|
BoundedInputStream(FSDataInputStream delegate,
long endOffsetExclusive) |
CompressibleFSDataInputStream(FSDataInputStream delegate,
StreamCompressionDecorator compressionDecorator) |
Modifier and Type | Class and Description |
---|---|
class |
FsSegmentDataInputStream
This class is a
WrappingProxy for FSDataInputStream that is
used to read from a file segment. |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
FileStateHandle.openInputStream() |
Constructor and Description |
---|
FsSegmentDataInputStream(FSDataInputStream inputStream,
long startingPosition,
long segmentSize) |
Modifier and Type | Method and Description |
---|---|
FSDataInputStream |
ByteStreamStateHandle.openInputStream() |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.