Definition #

Data Source is used to access metadata and read the changed data from external systems.
A Data Source can read data from multiple tables simultaneously.

Parameters #

To describe a data source, the follows are required:

parameter	meaning	optional/required
type	The type of the source, such as mysql.	required
name	The name of the source, which is user-defined (a default value provided).	optional
configurations of Data Source	Configurations to build the Data Source e.g. connection configurations and source table properties.	optional

Example #

We could use yaml files to define a mysql source:

source:
    type: mysql
    name: mysql-source   #optional，description information
    host: localhost
    port: 3306
    username: admin
    password: pass
    tables: adb.*, bdb.user_table_[0-9]+, [app|web]_order_\.*