@Experimental public interface WithPostCommitTopology<InputT,CommT> extends TwoPhaseCommittingSink<InputT,CommT>
Committer
.
It is recommended to use immutable committables because mutating committables can have unexpected side-effects.
TwoPhaseCommittingSink.CommitterInitContext, TwoPhaseCommittingSink.PrecommittingSinkWriter<InputT,CommT>
Sink.WriterInitContext
Modifier and Type | Method and Description |
---|---|
void |
addPostCommitTopology(DataStream<CommittableMessage<CommT>> committables)
Adds a custom post-commit topology where all committables can be processed.
|
createCommitter, createWriter, getCommittableSerializer
void addPostCommitTopology(DataStream<CommittableMessage<CommT>> committables)
It is strongly recommended to keep this pipeline stateless such that batch and streaming modes do not require special cases.
All operations need to be idempotent: on recovery, any number of committables may be replayed that have already been committed. It's mandatory that these committables have no effect on the external system.
committables
- the stream of committables.Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.