org.apache.flink.fs.osshadoop.writer

Class OSSCommitter

java.lang.Object

org.apache.flink.fs.osshadoop.writer.OSSCommitter

All Implemented Interfaces:

RecoverableFsDataOutputStream.Committer

public class OSSCommitter
extends Object
implements RecoverableFsDataOutputStream.Committer

Data object to commit an OSS MultiPartUpload.

Constructor Summary

Constructors

Constructor and Description
OSSCommitter(OSSAccessor ossAccessor, String objectName, String uploadId, List<com.aliyun.oss.model.PartETag> partETags, long totalLength)

Method Summary

Modifier and Type	Method and Description
void	commit() Commits the file, making it visible.
void	commitAfterRecovery() Commits the file, making it visible.
RecoverableWriter.CommitRecoverable	getRecoverable() Gets a recoverable object to recover the committer.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OSSCommitter

public OSSCommitter(OSSAccessor ossAccessor,
                    String objectName,
                    String uploadId,
                    List<com.aliyun.oss.model.PartETag> partETags,
                    long totalLength)

Method Detail

commit

public void commit()
            throws IOException

Description copied from interface: RecoverableFsDataOutputStream.Committer

Commits the file, making it visible. The file will contain the exact data as when the committer was created.

Specified by:

commit in interface RecoverableFsDataOutputStream.Committer

Throws:

IOException - Thrown if committing fails.

commitAfterRecovery

public void commitAfterRecovery()
                         throws IOException

Description copied from interface: RecoverableFsDataOutputStream.Committer

Commits the file, making it visible. The file will contain the exact data as when the committer was created.

This method tolerates situations where the file was already committed and will not raise an exception in that case. This is important for idempotent commit retries as they need to happen after recovery.

Specified by:

commitAfterRecovery in interface RecoverableFsDataOutputStream.Committer

Throws:

IOException - Thrown if committing fails.

getRecoverable

public RecoverableWriter.CommitRecoverable getRecoverable()

Description copied from interface: RecoverableFsDataOutputStream.Committer

Gets a recoverable object to recover the committer. The recovered committer will commit the file with the exact same data as this committer would commit it.

Specified by:

getRecoverable in interface RecoverableFsDataOutputStream.Committer