org.apache.flink.streaming.connectors.gcp.pubsub.common

Interface PubSubDeserializationSchema<T>

Type Parameters:

T - The type created by the deserialization schema.

All Superinterfaces:

ResultTypeQueryable<T>, Serializable

public interface PubSubDeserializationSchema<T>
extends Serializable, ResultTypeQueryable<T>

The deserialization schema describes how to turn the PubsubMessages into data types (Java/Scala objects) that are processed by Flink.

Method Summary

Modifier and Type	Method and Description
T	deserialize(com.google.pubsub.v1.PubsubMessage message) Deserializes a PubsubMessage.
default void	deserialize(com.google.pubsub.v1.PubsubMessage message, Collector<T> out) Deserializes the PubSub record.
boolean	isEndOfStream(T nextElement) Method to decide whether the element signals the end of the stream.
default void	open(DeserializationSchema.InitializationContext context) Initialization method for the schema.

Methods inherited from interface org.apache.flink.api.java.typeutils.ResultTypeQueryable

getProducedType

Method Detail

open

default void open(DeserializationSchema.InitializationContext context)
           throws Exception

Initialization method for the schema. It is called before the actual working methods deserialize(com.google.pubsub.v1.PubsubMessage) and thus suitable for one time setup work.

The provided DeserializationSchema.InitializationContext can be used to access additional features such as e.g. registering user metrics.

Parameters:

context - Contextual information that can be used during initialization.

Throws:

Exception

isEndOfStream

boolean isEndOfStream(T nextElement)

Method to decide whether the element signals the end of the stream. If true is returned the element won't be emitted.

Parameters:

nextElement - The element to test for the end-of-stream signal.

Returns:

True, if the element signals end of stream, false otherwise.

deserialize

T deserialize(com.google.pubsub.v1.PubsubMessage message)
       throws Exception

Deserializes a PubsubMessage.

Parameters:

message - PubsubMessage to be deserialized.

Returns:

The deserialized message as an object (null if the message cannot be deserialized).

Throws:

Exception

deserialize

default void deserialize(com.google.pubsub.v1.PubsubMessage message,
                         Collector<T> out)
                  throws Exception

Deserializes the PubSub record.

Can output multiple records through the Collector. Note that number and size of the produced records should be relatively small. Depending on the source implementation records can be buffered in memory or collecting records might delay emitting checkpoint barrier.

Parameters:

message - PubsubMessage to be deserialized.

out - The collector to put the resulting messages.

Throws:

Exception