org.apache.flink.streaming.api.connector.sink2

Interface WithPreCommitTopology<InputT,CommT>

All Superinterfaces:

Serializable, Sink<InputT>, TwoPhaseCommittingSink<InputT,CommT>

All Known Implementing Classes:

FileSink

@Experimental
public interface WithPreCommitTopology<InputT,CommT>
extends TwoPhaseCommittingSink<InputT,CommT>

Allows expert users to implement a custom topology after SinkWriter and before Committer.

It is recommended to use immutable committables because mutating committables can have unexpected side-effects.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

TwoPhaseCommittingSink.PrecommittingSinkWriter<InputT,CommT>

Nested classes/interfaces inherited from interface org.apache.flink.api.connector.sink2.Sink

Sink.InitContext

Method Summary

Modifier and Type	Method and Description
DataStream<CommittableMessage<CommT>>	addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables) Intercepts and modifies the committables sent on checkpoint or at end of input.

Methods inherited from interface org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

createCommitter, createWriter, getCommittableSerializer

Method Detail

addPreCommitTopology

DataStream<CommittableMessage<CommT>> addPreCommitTopology(DataStream<CommittableMessage<CommT>> committables)

Intercepts and modifies the committables sent on checkpoint or at end of input. Implementers need to ensure to modify all CommittableMessages appropriately.

Parameters:

committables - the stream of committables.

Returns:

the custom topology before Committer.