org.apache.flink.streaming.connectors.kafka

Class Kafka010AvroTableSource

java.lang.Object

org.apache.flink.streaming.connectors.kafka.KafkaTableSource

org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

org.apache.flink.streaming.connectors.kafka.Kafka010AvroTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.DefinedFieldMapping, org.apache.flink.table.sources.DefinedProctimeAttribute, org.apache.flink.table.sources.DefinedRowtimeAttributes, org.apache.flink.table.sources.StreamTableSource<Row>, org.apache.flink.table.sources.TableSource<Row>

@PublicEvolving
public class Kafka010AvroTableSource
extends KafkaAvroTableSource

Kafka StreamTableSource for Kafka 0.10.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Kafka010AvroTableSource.Builder A builder to configure and create a Kafka010AvroTableSource.

Constructor Summary

Constructors

Constructor and Description
Kafka010AvroTableSource(String topic, Properties properties, org.apache.flink.table.api.TableSchema schema, Class<? extends org.apache.avro.specific.SpecificRecordBase> record) Creates a Kafka 0.10 Avro StreamTableSource using a given SpecificRecord.

Method Summary

Modifier and Type	Method and Description
static Kafka010AvroTableSource.Builder	builder() Returns a builder to configure and create a Kafka010AvroTableSource.
protected FlinkKafkaConsumerBase<Row>	createKafkaConsumer(String topic, Properties properties, DeserializationSchema<Row> deserializationSchema) Creates a version-specific Kafka consumer.
void	setFieldMapping(Map<String,String> fieldMapping) Sets a mapping from schema fields to fields of the produced Avro record.
void	setProctimeAttribute(String proctimeAttribute) Declares a field of the schema to be a processing time attribute.
void	setRowtimeAttributeDescriptor(org.apache.flink.table.sources.RowtimeAttributeDescriptor rowtimeAttributeDescriptor) Declares a field of the schema to be a rowtime attribute.

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaAvroTableSource

explainSource, getDeserializationSchema, getFieldMapping

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaTableSource

equals, getDataStream, getKafkaConsumer, getProctimeAttribute, getReturnType, getRowtimeAttributeDescriptors, getTableSchema, hashCode, setRowtimeAttributeDescriptors, setSpecificStartupOffsets, setStartupMode

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Kafka010AvroTableSource

public Kafka010AvroTableSource(String topic,
                               Properties properties,
                               org.apache.flink.table.api.TableSchema schema,
                               Class<? extends org.apache.avro.specific.SpecificRecordBase> record)

Creates a Kafka 0.10 Avro StreamTableSource using a given SpecificRecord.

Parameters:

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

schema - Schema of the produced table.

record - Avro specific record.

Method Detail

setFieldMapping

public void setFieldMapping(Map<String,String> fieldMapping)

Sets a mapping from schema fields to fields of the produced Avro record.

A field mapping is required if the fields of produced tables should be named different than the fields of the Avro record. The key of the provided Map refers to the field of the table schema, the value to the field of the Avro record.

Overrides:

setFieldMapping in class KafkaAvroTableSource

Parameters:

fieldMapping - A mapping from schema fields to Avro fields.

setProctimeAttribute

public void setProctimeAttribute(String proctimeAttribute)

Declares a field of the schema to be a processing time attribute.

Overrides:

setProctimeAttribute in class KafkaTableSource

Parameters:

proctimeAttribute - The name of the field that becomes the processing time field.

setRowtimeAttributeDescriptor

public void setRowtimeAttributeDescriptor(org.apache.flink.table.sources.RowtimeAttributeDescriptor rowtimeAttributeDescriptor)

Declares a field of the schema to be a rowtime attribute.

Parameters:

rowtimeAttributeDescriptor - The descriptor of the rowtime attribute.

createKafkaConsumer

protected FlinkKafkaConsumerBase<Row> createKafkaConsumer(String topic,
                                                          Properties properties,
                                                          DeserializationSchema<Row> deserializationSchema)

Description copied from class: KafkaTableSource

Creates a version-specific Kafka consumer.

Specified by:

createKafkaConsumer in class KafkaTableSource

Parameters:

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

deserializationSchema - Deserialization schema to use for Kafka records.

Returns:

The version-specific Kafka consumer

builder

public static Kafka010AvroTableSource.Builder builder()

Returns a builder to configure and create a Kafka010AvroTableSource.

Returns:

A builder to configure and create a Kafka010AvroTableSource.