Modifier and Type | Method and Description |
---|---|
protected FileInputFormat.FileBaseStatistics |
FileInputFormat.getFileStats(FileInputFormat.FileBaseStatistics cachedStats,
Path filePath,
FileSystem fs,
ArrayList<FileStatus> files) |
Modifier and Type | Class and Description |
---|---|
class |
LimitedConnectionsFileSystem
A file system that limits the number of concurrently open input streams,
output streams, and total streams for a target file system.
|
class |
SafetyNetWrapperFileSystem
This is a
WrappingProxy around FileSystem which (i) wraps all opened streams as
ClosingFSDataInputStream or ClosingFSDataOutputStream and (ii) registers them to
a SafetyNetCloseableRegistry . |
Modifier and Type | Method and Description |
---|---|
FileSystem |
FileSystemFactory.create(URI fsUri)
Creates a new file system for the given file system URI.
|
FileSystem |
ConnectionLimitingFactory.create(URI fsUri) |
static FileSystem |
FileSystem.get(URI uri)
Returns a reference to the
FileSystem instance for accessing the
file system identified by the given URI . |
FileSystem |
Path.getFileSystem()
Returns the FileSystem that owns this Path.
|
static FileSystem |
FileSystem.getLocalFileSystem()
Returns a reference to the
FileSystem instance for accessing the local file system. |
static FileSystem |
FileSystem.getUnguardedFileSystem(URI fsUri) |
FileSystem |
SafetyNetWrapperFileSystem.getWrappedDelegate() |
Modifier and Type | Method and Description |
---|---|
static OutputStreamAndPath |
EntropyInjector.createEntropyAware(FileSystem fs,
Path path,
FileSystem.WriteMode writeMode)
Handles entropy injection across regular and entropy-aware file systems.
|
Path |
Path.makeQualified(FileSystem fs)
Returns a qualified path object.
|
static Path |
EntropyInjector.removeEntropyMarkerIfPresent(FileSystem fs,
Path path)
Removes the entropy marker string from the path, if the given file system is an
entropy-injecting file system (implements
EntropyInjectingFileSystem ) and
the entropy marker key is present. |
Constructor and Description |
---|
LimitedConnectionsFileSystem(FileSystem originalFs,
int maxNumOpenStreamsTotal)
Creates a new output connection limiting file system.
|
LimitedConnectionsFileSystem(FileSystem originalFs,
int maxNumOpenStreamsTotal,
int maxNumOpenOutputStreams,
int maxNumOpenInputStreams,
long streamOpenTimeout,
long streamInactivityTimeout)
Creates a new output connection limiting file system, limiting input and output streams with
potentially different quotas.
|
LimitedConnectionsFileSystem(FileSystem originalFs,
int maxNumOpenStreamsTotal,
long streamOpenTimeout,
long streamInactivityTimeout)
Creates a new output connection limiting file system.
|
SafetyNetWrapperFileSystem(FileSystem unsafeFileSystem,
SafetyNetCloseableRegistry registry) |
Modifier and Type | Class and Description |
---|---|
class |
LocalFileSystem
The class
LocalFileSystem is an implementation of the FileSystem interface
for the local file system of the machine where the JVM runs. |
Modifier and Type | Method and Description |
---|---|
FileSystem |
LocalFileSystemFactory.create(URI fsUri) |
Constructor and Description |
---|
LocalFileStatus(File f,
FileSystem fs)
Creates a
LocalFileStatus object from a given File object. |
Modifier and Type | Method and Description |
---|---|
FileSystem |
SwiftFileSystemFactory.create(URI fsUri) |
Modifier and Type | Method and Description |
---|---|
FileSystem |
OSSFileSystemFactory.create(URI fsUri) |
Modifier and Type | Class and Description |
---|---|
class |
FlinkS3FileSystem
Implementation of the Flink
FileSystem interface for S3. |
Modifier and Type | Method and Description |
---|---|
FileSystem |
AbstractS3FileSystemFactory.create(URI fsUri) |
Constructor and Description |
---|
FileSystemBlobStore(FileSystem fileSystem,
String storagePath) |
Modifier and Type | Class and Description |
---|---|
class |
HadoopFileSystem
A
FileSystem that wraps an Hadoop File System . |
Modifier and Type | Method and Description |
---|---|
FileSystem |
HadoopFsFactory.create(URI fsUri) |
Modifier and Type | Method and Description |
---|---|
FileSystem |
MapRFsFactory.create(URI fsUri) |
Constructor and Description |
---|
FsNegativeRunningJobsRegistry(FileSystem fileSystem,
Path workingDirectory)
Creates a new registry that writes its files to the given FileSystem at
the given working directory path.
|
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
SnapshotDirectory.fileSystem
The filesystem that contains the snapshot directory.
|
Modifier and Type | Method and Description |
---|---|
FileSystem |
SnapshotDirectory.getFileSystem() |
Modifier and Type | Method and Description |
---|---|
protected CheckpointStorageLocation |
FsCheckpointStorage.createSavepointLocation(FileSystem fs,
Path location) |
protected abstract CheckpointStorageLocation |
AbstractFsCheckpointStorage.createSavepointLocation(FileSystem fs,
Path location) |
Constructor and Description |
---|
FileBasedStateOutputStream(FileSystem fileSystem,
Path path) |
FsCheckpointMetadataOutputStream(FileSystem fileSystem,
Path metadataFilePath,
Path exclusiveCheckpointDir) |
FsCheckpointStateOutputStream(Path basePath,
FileSystem fs,
int bufferSize,
int localStateThreshold) |
FsCheckpointStorage(FileSystem fs,
Path checkpointBaseDirectory,
Path defaultSavepointDirectory,
JobID jobId,
int fileSizeThreshold) |
FsCheckpointStorageLocation(FileSystem fileSystem,
Path checkpointDir,
Path sharedStateDir,
Path taskOwnedStateDir,
CheckpointStorageLocationReference reference,
int fileStateSizeThreshold) |
FsCheckpointStreamFactory(FileSystem fileSystem,
Path checkpointDirectory,
Path sharedStateDirectory,
int fileStateSizeThreshold)
Creates a new stream factory that stores its checkpoint data in the file system and location
defined by the given Path.
|
FsCompletedCheckpointStorageLocation(FileSystem fs,
Path exclusiveCheckpointDir,
FileStateHandle metadataFileHandle,
String externalPointer) |
Modifier and Type | Method and Description |
---|---|
protected CheckpointStorageLocation |
MemoryBackendCheckpointStorage.createSavepointLocation(FileSystem fs,
Path location) |
Constructor and Description |
---|
PersistentMetadataCheckpointStorageLocation(FileSystem fileSystem,
Path checkpointDir,
int maxStateSize)
Creates a checkpoint storage persists metadata to a file system and stores state
in line in state handles with the metadata.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
FileUtils.deletePathIfEmpty(FileSystem fileSystem,
Path path)
Deletes the path if it is empty.
|
Modifier and Type | Field and Description |
---|---|
protected FileSystem |
YarnHighAvailabilityServices.flinkFileSystem
The Flink FileSystem object that represent the HDFS used by YARN.
|
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.