Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.InProgressFileRecoverable |
FileSinkCommittable.getInProgressFileToCleanup() |
Constructor and Description |
---|
FileSinkCommittable(String bucketId,
InProgressFileWriter.InProgressFileRecoverable inProgressFileToCleanup) |
Constructor and Description |
---|
FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileSerializer,
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileSerializer) |
Constructor and Description |
---|
FileWriterBucketState(String bucketId,
Path bucketPath,
long inProgressFileCreationTime,
InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable) |
FileWriterBucketState(String bucketId,
Path bucketPath,
long inProgressFileCreationTime,
InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable,
Map<Long,List<InProgressFileWriter.PendingFileRecoverable>> pendingFileRecoverablesPerCheckpoint) |
Constructor and Description |
---|
FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer) |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.InProgressFileRecoverable |
HadoopPathBasedPartFileWriter.persist() |
Modifier and Type | Method and Description |
---|---|
boolean |
HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter.cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable) |
InProgressFileWriter<IN,BucketID> |
HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter.resumeInProgressFileFrom(BucketID bucketID,
InProgressFileWriter.InProgressFileRecoverable inProgressFileSnapshot,
long creationTime) |
Modifier and Type | Class and Description |
---|---|
static class |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
The
InProgressFileRecoverable implementation for OutputStreamBasedBucketWriter . |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.InProgressFileRecoverable |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer.deserialize(int version,
byte[] serialized) |
InProgressFileWriter.InProgressFileRecoverable |
OutputStreamBasedPartFileWriter.persist() |
InProgressFileWriter.InProgressFileRecoverable |
InProgressFileWriter.persist() |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> |
WriterProperties.getInProgressFileRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
boolean |
BucketWriter.cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable)
Frees up any resources that were previously occupied in order to be able to recover from a
(potential) failure.
|
InProgressFileWriter<IN,BucketID> |
BucketWriter.resumeInProgressFileFrom(BucketID bucketID,
InProgressFileWriter.InProgressFileRecoverable inProgressFileSnapshot,
long creationTime)
Used to resume a
InProgressFileWriter from a InProgressFileWriter.InProgressFileRecoverable . |
byte[] |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer.serialize(InProgressFileWriter.InProgressFileRecoverable inProgressRecoverable) |
Constructor and Description |
---|
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.