Definition #
Data Sink is used to apply schema changes and write change data to external systems.
A Data Sink can write to multiple tables simultaneously.
Parameters #
To describe a data sink, the follows are required:
parameter | meaning | optional/required |
---|---|---|
type | The type of the sink, such as doris or starrocks. | required |
name | The name of the sink, which is user-defined (a default value provided). | optional |
configurations of Data Sink | Configurations to build the Data Sink e.g. connection configurations and sink table properties. | optional |
Example #
We could use this yaml file to define a doris sink:
sink:
type: doris
name: doris-sink # Optional parameter for description purpose
fenodes: 127.0.0.1:8030
username: root
password: ""
table.create.properties.replication_num: 1 # Optional parameter for advanced functionalities