Modifier and Type | Class and Description |
---|---|
class |
CommitterFromPersistRecoverableFsDataOutputStream<RESUME_RECOVERABLE extends RecoverableWriter.ResumeRecoverable>
RecoverableFsDataOutputStream with fixed implementation of CommitterFromPersistRecoverableFsDataOutputStream.closeForCommit() that
is based on using CommitterFromPersistRecoverableFsDataOutputStream.persist() to ensure durability and creates the RecoverableFsDataOutputStream.Committer from the corresponding RecoverableWriter.ResumeRecoverable . |
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
RecoverableWriter.open(Path path)
Opens a new recoverable stream to write to the given path.
|
RecoverableFsDataOutputStream |
RecoverableWriter.recover(RecoverableWriter.ResumeRecoverable resumable)
Resumes a recoverable stream consistently at the point indicated by the given
ResumeRecoverable.
|
Modifier and Type | Class and Description |
---|---|
class |
LocalRecoverableFsDataOutputStream
A
RecoverableFsDataOutputStream for the LocalFileSystem . |
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
LocalRecoverableWriter.open(Path filePath) |
RecoverableFsDataOutputStream |
LocalRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Class and Description |
---|---|
class |
AzureBlobFsRecoverableDataOutputStream
An implementation of the
RecoverableFsDataOutputStream for AzureBlob's file system
abstraction. |
Modifier and Type | Method and Description |
---|---|
protected RecoverableFsDataOutputStream |
AzureBlobRecoverableWriter.getRecoverableFsDataOutputStream(org.apache.hadoop.fs.Path targetFile,
org.apache.hadoop.fs.Path tempFile) |
RecoverableFsDataOutputStream |
AzureBlobRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
GSRecoverableWriter.open(Path path) |
RecoverableFsDataOutputStream |
GSRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable resumable) |
Modifier and Type | Class and Description |
---|---|
class |
OSSRecoverableFsDataOutputStream
A RecoverableFsDataOutputStream to OSS that is based on a recoverable multipart upload.
|
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
OSSRecoverableWriter.open(Path path) |
Modifier and Type | Class and Description |
---|---|
class |
S3RecoverableFsDataOutputStream
A RecoverableFsDataOutputStream to S3 that is based on a recoverable multipart upload.
|
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
S3RecoverableWriter.open(Path path) |
Modifier and Type | Class and Description |
---|---|
class |
BaseHadoopFsRecoverableFsDataOutputStream
Base class for ABFS and Hadoop recoverable stream.
|
Modifier and Type | Method and Description |
---|---|
protected RecoverableFsDataOutputStream |
HadoopRecoverableWriter.getRecoverableFsDataOutputStream(org.apache.hadoop.fs.Path targetFile,
org.apache.hadoop.fs.Path tempFile) |
RecoverableFsDataOutputStream |
HadoopRecoverableWriter.open(Path filePath) |
RecoverableFsDataOutputStream |
HadoopRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Constructor and Description |
---|
RecoverableStreamWrapper(RecoverableFsDataOutputStream out) |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter<IN,BucketID> |
RowWiseBucketWriter.openNew(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
long creationTime) |
InProgressFileWriter<IN,BucketID> |
BulkBucketWriter.openNew(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
long creationTime) |
InProgressFileWriter<IN,BucketID> |
RowWiseBucketWriter.resumeFrom(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
RecoverableWriter.ResumeRecoverable resumable,
long creationTime) |
InProgressFileWriter<IN,BucketID> |
BulkBucketWriter.resumeFrom(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
RecoverableWriter.ResumeRecoverable resumable,
long creationTime) |
Constructor and Description |
---|
RowWisePartWriter(BucketID bucketId,
Path path,
RecoverableFsDataOutputStream currentPartStream,
Encoder<IN> encoder,
long creationTime) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.