Package org.apache.flink.formats.avro.registry.confluent.debezium

Class DebeziumAvroDeserializationSchema

java.lang.Object

org.apache.flink.formats.avro.registry.confluent.debezium.DebeziumAvroDeserializationSchema

All Implemented Interfaces:

Serializable, DeserializationSchema<RowData>, ResultTypeQueryable<RowData>

@Internal
public final class DebeziumAvroDeserializationSchema
extends Object
implements DeserializationSchema<RowData>

Deserialization schema from Debezium Avro to Flink Table/SQL internal data structure RowData. The deserialization schema knows Debezium's schema definition and can extract the database data and convert into RowData with RowKind. Deserializes a byte[] message as a JSON object and reads the specified fields. Failures during deserialization are forwarded as wrapped IOExceptions.

See Also:

Debezium, Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.api.common.serialization.DeserializationSchema

DeserializationSchema.InitializationContext

Constructor Summary

Constructors

Constructor	Description
DebeziumAvroDeserializationSchema(RowType rowType, TypeInformation<RowData> producedTypeInfo, String schemaRegistryUrl, String schemaString, Map<String,?> registryConfigs)

Method Summary

Modifier and Type	Method	Description
static RowType	createDebeziumAvroRowType(DataType databaseSchema)
RowData	deserialize(byte[] message)	Deserializes the byte message.
void	deserialize(byte[] message, Collector<RowData> out)	Deserializes the byte message.
boolean	equals(Object o)
TypeInformation<RowData>	getProducedType()	Gets the data type (as a TypeInformation) produced by this function or input format.
int	hashCode()
boolean	isEndOfStream(RowData nextElement)	Method to decide whether the element signals the end of the stream.
void	open(DeserializationSchema.InitializationContext context)	Initialization method for the schema.

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DebeziumAvroDeserializationSchema

public DebeziumAvroDeserializationSchema(RowType rowType,
                                         TypeInformation<RowData> producedTypeInfo,
                                         String schemaRegistryUrl,
                                         @Nullable
                                         String schemaString,
                                         @Nullable
                                         Map<String,?> registryConfigs)

Method Detail

open

public void open(DeserializationSchema.InitializationContext context)
          throws Exception

Description copied from interface: DeserializationSchema

Initialization method for the schema. It is called before the actual working methods DeserializationSchema.deserialize(byte[]) and thus suitable for one time setup work.

The provided DeserializationSchema.InitializationContext can be used to access additional features such as e.g. registering user metrics.

Specified by:

open in interface DeserializationSchema<RowData>

Parameters:

context - Contextual information that can be used during initialization.

Throws:

Exception

deserialize

public RowData deserialize(byte[] message)
                    throws IOException

Description copied from interface: DeserializationSchema

Deserializes the byte message.

Specified by:

deserialize in interface DeserializationSchema<RowData>

Parameters:

message - The message, as a byte array.

Returns:

The deserialized message as an object (null if the message cannot be deserialized).

Throws:

IOException

deserialize

public void deserialize(byte[] message,
                        Collector<RowData> out)
                 throws IOException

Description copied from interface: DeserializationSchema

Deserializes the byte message.

Can output multiple records through the Collector. Note that number and size of the produced records should be relatively small. Depending on the source implementation records can be buffered in memory or collecting records might delay emitting checkpoint barrier.

Specified by:

deserialize in interface DeserializationSchema<RowData>

Parameters:

message - The message, as a byte array.

out - The collector to put the resulting messages.

Throws:

IOException

isEndOfStream

public boolean isEndOfStream(RowData nextElement)

Description copied from interface: DeserializationSchema

Method to decide whether the element signals the end of the stream. If true is returned the element won't be emitted.

Specified by:

isEndOfStream in interface DeserializationSchema<RowData>

Parameters:

nextElement - The element to test for the end-of-stream signal.

Returns:

True, if the element signals end of stream, false otherwise.

getProducedType

public TypeInformation<RowData> getProducedType()

Description copied from interface: ResultTypeQueryable

Gets the data type (as a TypeInformation) produced by this function or input format.

Specified by:

getProducedType in interface ResultTypeQueryable<RowData>

Returns:

The data type produced by this function or input format.

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

createDebeziumAvroRowType

public static RowType createDebeziumAvroRowType(DataType databaseSchema)