org.apache.flink.streaming.connectors.kafka

Class KafkaAvroTableSource

java.lang.Object

org.apache.flink.streaming.connectors.kafka.KafkaTableSource

org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.DefinedFieldMapping, org.apache.flink.table.sources.DefinedProctimeAttribute, org.apache.flink.table.sources.DefinedRowtimeAttributes, org.apache.flink.table.sources.StreamTableSource<Row>, org.apache.flink.table.sources.TableSource<Row>

Direct Known Subclasses:

Kafka010AvroTableSource, Kafka011AvroTableSource, Kafka08AvroTableSource, Kafka09AvroTableSource

public abstract class KafkaAvroTableSource
extends KafkaTableSource
implements org.apache.flink.table.sources.DefinedFieldMapping

A version-agnostic Kafka Avro StreamTableSource.

The version-specific Kafka consumers need to extend this class and override KafkaTableSource.createKafkaConsumer(String, Properties, DeserializationSchema)}.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	KafkaAvroTableSource.Builder<T extends KafkaAvroTableSource,B extends KafkaAvroTableSource.Builder> Abstract builder for a KafkaAvroTableSource to be extended by builders of subclasses of KafkaAvroTableSource.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	KafkaAvroTableSource(String topic, Properties properties, org.apache.flink.table.api.TableSchema schema, Class<? extends org.apache.avro.specific.SpecificRecordBase> avroRecordClass) Creates a generic Kafka Avro StreamTableSource using a given SpecificRecord.

Method Summary

Modifier and Type	Method and Description
String	explainSource()
protected AvroRowDeserializationSchema	getDeserializationSchema() Returns the deserialization schema.
Map<String,String>	getFieldMapping()
protected void	setFieldMapping(Map<String,String> fieldMapping) Configures a field mapping for this TableSource.

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaTableSource

createKafkaConsumer, getDataStream, getKafkaConsumer, getProctimeAttribute, getReturnType, getRowtimeAttributeDescriptors, getTableSchema, setProctimeAttribute, setRowtimeAttributeDescriptors, setSpecificStartupOffsets, setStartupMode

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaAvroTableSource

protected KafkaAvroTableSource(String topic,
                               Properties properties,
                               org.apache.flink.table.api.TableSchema schema,
                               Class<? extends org.apache.avro.specific.SpecificRecordBase> avroRecordClass)

Creates a generic Kafka Avro StreamTableSource using a given SpecificRecord.

Parameters:

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

schema - Schema of the produced table.

avroRecordClass - Class of the Avro record that is read from the Kafka topic.

Method Detail

getFieldMapping

public Map<String,String> getFieldMapping()

Specified by:

getFieldMapping in interface org.apache.flink.table.sources.DefinedFieldMapping

explainSource

public String explainSource()

Specified by:

explainSource in interface org.apache.flink.table.sources.TableSource<Row>

getDeserializationSchema

protected AvroRowDeserializationSchema getDeserializationSchema()

Description copied from class: KafkaTableSource

Returns the deserialization schema.

Specified by:

getDeserializationSchema in class KafkaTableSource

Returns:

The deserialization schema

setFieldMapping

protected void setFieldMapping(Map<String,String> fieldMapping)

Configures a field mapping for this TableSource.

Parameters:

fieldMapping - The field mapping.