Modifier and Type | Class and Description |
---|---|
class |
CommitterFromPersistRecoverableFsDataOutputStream<RESUME_RECOVERABLE extends RecoverableWriter.ResumeRecoverable>
RecoverableFsDataOutputStream with fixed implementation of CommitterFromPersistRecoverableFsDataOutputStream.closeForCommit() that
is based on using CommitterFromPersistRecoverableFsDataOutputStream.persist() to ensure durability and creates the RecoverableFsDataOutputStream.Committer from the corresponding RecoverableWriter.ResumeRecoverable . |
Modifier and Type | Method and Description |
---|---|
abstract RecoverableWriter.ResumeRecoverable |
RecoverableFsDataOutputStream.persist()
Ensures all data so far is persistent (similar to
FSDataOutputStream.sync() ) and returns a handle to
recover the stream at the current position. |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
RecoverableWriter.getResumeRecoverableSerializer()
The serializer for the ResumeRecoverable types created in this writer.
|
Modifier and Type | Method and Description |
---|---|
boolean |
RecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable)
Frees up any resources that were previously occupied in order to be able to recover from a
(potential) failure.
|
RecoverableFsDataOutputStream |
RecoverableWriter.recover(RecoverableWriter.ResumeRecoverable resumable)
Resumes a recoverable stream consistently at the point indicated by the given
ResumeRecoverable.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
LocalRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
LocalRecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable) |
RecoverableFsDataOutputStream |
LocalRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Method and Description |
---|---|
RecoverableFsDataOutputStream |
AzureBlobRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
GSRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
GSRecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable) |
RecoverableFsDataOutputStream |
GSRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable resumable) |
Modifier and Type | Class and Description |
---|---|
class |
OSSRecoverable
Data object to recover an OSS MultiPartUpload for a recoverable output stream.
|
Modifier and Type | Method and Description |
---|---|
RecoverableWriter.ResumeRecoverable |
OSSRecoverableFsDataOutputStream.persist() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
OSSRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
OSSRecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable) |
OSSRecoverableFsDataOutputStream |
OSSRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable resumable) |
Modifier and Type | Class and Description |
---|---|
class |
S3Recoverable
Data object to recover an S3 MultiPartUpload for a recoverable output stream.
|
Modifier and Type | Method and Description |
---|---|
RecoverableWriter.ResumeRecoverable |
S3RecoverableFsDataOutputStream.persist() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
S3RecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
S3RecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable) |
S3RecoverableFsDataOutputStream |
S3RecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Class and Description |
---|---|
class |
HadoopFsRecoverable
An implementation of the resume and commit descriptor objects for Hadoop's/AzureBlob file system
abstraction.
|
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
HadoopRecoverableWriter.getResumeRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
HadoopRecoverableWriter.cleanupRecoverableState(RecoverableWriter.ResumeRecoverable resumable) |
RecoverableFsDataOutputStream |
HadoopRecoverableWriter.recover(RecoverableWriter.ResumeRecoverable recoverable) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<RecoverableWriter.ResumeRecoverable> |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer.getResumeSerializer() |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter<IN,BucketID> |
RowWiseBucketWriter.resumeFrom(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
RecoverableWriter.ResumeRecoverable resumable,
long creationTime) |
InProgressFileWriter<IN,BucketID> |
BulkBucketWriter.resumeFrom(BucketID bucketId,
RecoverableFsDataOutputStream stream,
Path path,
RecoverableWriter.ResumeRecoverable resumable,
long creationTime) |
Constructor and Description |
---|
OutputStreamBasedInProgressFileRecoverable(RecoverableWriter.ResumeRecoverable resumeRecoverable)
Deprecated.
|
OutputStreamBasedInProgressFileRecoverable(RecoverableWriter.ResumeRecoverable resumeRecoverable,
Path targetPath) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.