Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.PendingFileRecoverable |
FileSinkCommittable.getPendingFile() |
Constructor and Description |
---|
FileSinkCommittable(String bucketId,
InProgressFileWriter.PendingFileRecoverable pendingFile) |
Constructor and Description |
---|
FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileSerializer,
SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileSerializer) |
Modifier and Type | Method and Description |
---|---|
Map<Long,List<InProgressFileWriter.PendingFileRecoverable>> |
FileWriterBucketState.getPendingFileRecoverablesPerCheckpoint() |
Constructor and Description |
---|
FileWriterBucketState(String bucketId,
Path bucketPath,
long inProgressFileCreationTime,
InProgressFileWriter.InProgressFileRecoverable inProgressFileRecoverable,
Map<Long,List<InProgressFileWriter.PendingFileRecoverable>> pendingFileRecoverablesPerCheckpoint) |
FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer) |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.PendingFileRecoverable |
HadoopPathBasedPartFileWriter.closeForCommit() |
Modifier and Type | Method and Description |
---|---|
BucketWriter.PendingFile |
HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter.recoverPendingFile(InProgressFileWriter.PendingFileRecoverable pendingFileRecoverable) |
Modifier and Type | Interface and Description |
---|---|
static interface |
InProgressFileWriter.InProgressFileRecoverable
A handle can be used to recover in-progress file..
|
Modifier and Type | Class and Description |
---|---|
static class |
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
The
InProgressFileRecoverable implementation for OutputStreamBasedBucketWriter . |
static class |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
The
PendingFileRecoverable implementation for OutputStreamBasedBucketWriter . |
Modifier and Type | Method and Description |
---|---|
InProgressFileWriter.PendingFileRecoverable |
CompactingFileWriter.closeForCommit()
Closes the writer and gets the
InProgressFileWriter.PendingFileRecoverable of the written compacting file. |
InProgressFileWriter.PendingFileRecoverable |
OutputStreamBasedPartFileWriter.closeForCommit() |
InProgressFileWriter.PendingFileRecoverable |
InProgressFileWriter.closeForCommit() |
InProgressFileWriter.PendingFileRecoverable |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer.deserialize(int version,
byte[] serialized) |
Modifier and Type | Method and Description |
---|---|
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> |
WriterProperties.getPendingFileRecoverableSerializer() |
Modifier and Type | Method and Description |
---|---|
BucketWriter.PendingFile |
BucketWriter.recoverPendingFile(InProgressFileWriter.PendingFileRecoverable pendingFileRecoverable)
Recovers a pending file for finalizing and committing.
|
byte[] |
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer.serialize(InProgressFileWriter.PendingFileRecoverable pendingFileRecoverable) |
Constructor and Description |
---|
WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable> inProgressFileRecoverableSerializer,
SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable> pendingFileRecoverableSerializer,
boolean supportsResume) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.