Data Sink

Definition #

Data Sink is used to apply schema changes and write change data to external systems.
A Data Sink can write to multiple tables simultaneously.

Parameters #

To describe a data sink, the follows are required:

parameter meaning optional/required
type The type of the sink, such as doris or starrocks. required
name The name of the sink, which is user-defined (a default value provided). optional
configurations of Data Sink Configurations to build the Data Sink e.g. connection configurations and sink table properties. optional

Example #

We could use this yaml file to define a doris sink:

sink:
    type: doris
    name: doris-sink           	# Optional parameter for description purpose
    fenodes: 127.0.0.1:8030
    username: root
    password: ""
    table.create.properties.replication_num: 1      	# Optional parameter for advanced functionalities