@PublicEvolving public interface DataStreamSinkProvider extends DynamicTableSink.SinkRuntimeProvider, ParallelismProvider
DataStreamas a runtime implementation for
Note: This provider is only meant for advanced connector developers. Usually, a sink should
consist of a single entity expressed via
OutputFormatProvider. When using a
DataStream an implementer needs to pay
attention to how changes are shuffled to not mess up the changelog per parallel subtask.
|Modifier and Type||Method and Description|
Consumes the given Java
Returns the parallelism for this instance.
DataStreamSink<?> consumeDataStream(DataStream<RowData> dataStream)
DataStreamand returns the sink transformation
default Optional<Integer> getParallelism()
The parallelism denotes how many parallel instances of a source or sink will be spawned during the execution.
Enforcing a different parallelism for sinks might mess up the changelog if the input is
ChangelogMode.insertOnly(). Therefore, a primary key is required by which the
input will be shuffled before records enter the
Note: If a custom parallelism is returned and
applies multiple transformations, make sure to set the same custom parallelism to each
operator to not mess up the changelog.
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.