Flink provides a set of table formats that can be used with table connectors. A table format is a storage format that defines how to map binary data onto table columns.
Flink supports the following formats:
Formats |
Supported Connectors |
CSV |
Apache Kafka,
Upsert Kafka,
Amazon Kinesis Data Streams,
Amazon Kinesis Data Firehose,
Filesystem |
JSON |
Apache Kafka,
Upsert Kafka,
Amazon Kinesis Data Streams,
Amazon Kinesis Data Firehose,
Filesystem,
Elasticsearch |
Apache Avro |
Apache Kafka,
Upsert Kafka,
Amazon Kinesis Data Streams,
Amazon Kinesis Data Firehose,
Filesystem |
Confluent Avro |
Apache Kafka,
Upsert Kafka |
Protobuf |
Apache Kafka |
Debezium CDC |
Apache Kafka,
Filesystem |
Canal CDC |
Apache Kafka,
Filesystem |
Maxwell CDC |
Apache Kafka,
Filesystem |
OGG CDC |
Apache Kafka,
Filesystem |
Apache Parquet |
Filesystem |
Apache ORC |
Filesystem |
Raw |
Apache Kafka,
Upsert Kafka,
Amazon Kinesis Data Streams,
Amazon Kinesis Data Firehose,
Filesystem |