org.apache.flink.streaming.connectors.kafka

Class KafkaTableSource

java.lang.Object

org.apache.flink.streaming.connectors.kafka.KafkaTableSourceBase

org.apache.flink.streaming.connectors.kafka.KafkaTableSource

All Implemented Interfaces:

DefinedFieldMapping, DefinedProctimeAttribute, DefinedRowtimeAttributes, StreamTableSource<Row>, TableSource<Row>

@Internal
public class KafkaTableSource
extends KafkaTableSourceBase

Kafka StreamTableSource.

Constructor Summary

Constructors

Constructor and Description
KafkaTableSource(TableSchema schema, Optional<String> proctimeAttribute, List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors, Optional<Map<String,String>> fieldMapping, String topic, Properties properties, DeserializationSchema<Row> deserializationSchema, StartupMode startupMode, Map<KafkaTopicPartition,Long> specificStartupOffsets) Creates a generic Kafka StreamTableSource.
KafkaTableSource(TableSchema schema, String topic, Properties properties, DeserializationSchema<Row> deserializationSchema) Creates a generic Kafka StreamTableSource.

Method Summary

Modifier and Type	Method and Description
protected FlinkKafkaConsumerBase<Row>	createKafkaConsumer(String topic, Properties properties, DeserializationSchema<Row> deserializationSchema) Creates a version-specific Kafka consumer.

Methods inherited from class org.apache.flink.streaming.connectors.kafka.KafkaTableSourceBase

equals, explainSource, getDataStream, getDeserializationSchema, getFieldMapping, getKafkaConsumer, getProctimeAttribute, getProperties, getReturnType, getRowtimeAttributeDescriptors, getTableSchema, hashCode

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.sources.StreamTableSource

isBounded

Methods inherited from interface org.apache.flink.table.sources.TableSource

getProducedDataType

Constructor Detail

KafkaTableSource

public KafkaTableSource(TableSchema schema,
                        Optional<String> proctimeAttribute,
                        List<RowtimeAttributeDescriptor> rowtimeAttributeDescriptors,
                        Optional<Map<String,String>> fieldMapping,
                        String topic,
                        Properties properties,
                        DeserializationSchema<Row> deserializationSchema,
                        StartupMode startupMode,
                        Map<KafkaTopicPartition,Long> specificStartupOffsets)

Creates a generic Kafka StreamTableSource.

Parameters:

schema - Schema of the produced table.

proctimeAttribute - Field name of the processing time attribute.

rowtimeAttributeDescriptors - Descriptor for a rowtime attribute

fieldMapping - Mapping for the fields of the table schema to fields of the physical returned type.

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

deserializationSchema - Deserialization schema for decoding records from Kafka.

startupMode - Startup mode for the contained consumer.

specificStartupOffsets - Specific startup offsets; only relevant when startup mode is StartupMode.SPECIFIC_OFFSETS.

KafkaTableSource

public KafkaTableSource(TableSchema schema,
                        String topic,
                        Properties properties,
                        DeserializationSchema<Row> deserializationSchema)

Creates a generic Kafka StreamTableSource.

Parameters:

schema - Schema of the produced table.

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

deserializationSchema - Deserialization schema for decoding records from Kafka.

Method Detail

createKafkaConsumer

protected FlinkKafkaConsumerBase<Row> createKafkaConsumer(String topic,
                                                          Properties properties,
                                                          DeserializationSchema<Row> deserializationSchema)

Description copied from class: KafkaTableSourceBase

Creates a version-specific Kafka consumer.

Specified by:

createKafkaConsumer in class KafkaTableSourceBase

Parameters:

topic - Kafka topic to consume.

properties - Properties for the Kafka consumer.

deserializationSchema - Deserialization schema to use for Kafka records.

Returns:

The version-specific Kafka consumer