org.apache.flink.table.runtime.operators.join.stream

Class AbstractStreamingJoinOperator

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<RowData>

org.apache.flink.table.runtime.operators.join.stream.AbstractStreamingJoinOperator

All Implemented Interfaces:

Serializable, CheckpointListener, KeyContext, KeyContextHandler, SetupableStreamOperator<RowData>, StreamOperator<RowData>, StreamOperatorStateHandler.CheckpointedStreamOperator, TwoInputStreamOperator<RowData,RowData,RowData>, YieldingOperator<RowData>

Direct Known Subclasses:

StreamingJoinOperator, StreamingSemiAntiJoinOperator

public abstract class AbstractStreamingJoinOperator
extends AbstractStreamOperator<RowData>
implements TwoInputStreamOperator<RowData,RowData,RowData>

Abstract implementation for streaming unbounded Join operator which defines some member fields can be shared between different implementations.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	AbstractStreamingJoinOperator.AssociatedRecords The AbstractStreamingJoinOperator.AssociatedRecords is the records associated to the input row.
protected static class	AbstractStreamingJoinOperator.OuterRecord An AbstractStreamingJoinOperator.OuterRecord is a composite of record and numOfAssociations.

Field Summary

Fields

Modifier and Type	Field and Description
protected TimestampedCollector<RowData>	collector
protected JoinConditionWithNullFilters	joinCondition
protected static String	LEFT_RECORDS_STATE_NAME
protected JoinInputSideSpec	leftInputSideSpec
protected long	leftStateRetentionTime
protected InternalTypeInfo<RowData>	leftType
protected static String	RIGHT_RECORDS_STATE_NAME
protected JoinInputSideSpec	rightInputSideSpec
protected long	rightStateRetentionTime
protected InternalTypeInfo<RowData>	rightType

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

Constructor Summary

Constructors

Constructor and Description
AbstractStreamingJoinOperator(InternalTypeInfo<RowData> leftType, InternalTypeInfo<RowData> rightType, GeneratedJoinCondition generatedJoinCondition, JoinInputSideSpec leftInputSideSpec, JoinInputSideSpec rightInputSideSpec, boolean[] filterNullKeys, long leftStateRetentionTime, long rightStateRetentionTime)

Method Summary

Modifier and Type	Method and Description
void	close() This method is called at the very end of the operator's life, both in the case of a successful completion of the operation, and in the case of a failure and canceling.
void	open() This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processElement1, processElement2, processLatencyMarker1, processLatencyMarker2, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Field Detail

LEFT_RECORDS_STATE_NAME

protected static final String LEFT_RECORDS_STATE_NAME

See Also:

Constant Field Values

RIGHT_RECORDS_STATE_NAME

protected static final String RIGHT_RECORDS_STATE_NAME

See Also:

Constant Field Values

leftType

protected final InternalTypeInfo<RowData> leftType

rightType

protected final InternalTypeInfo<RowData> rightType

leftInputSideSpec

protected final JoinInputSideSpec leftInputSideSpec

rightInputSideSpec

protected final JoinInputSideSpec rightInputSideSpec

leftStateRetentionTime

protected final long leftStateRetentionTime

rightStateRetentionTime

protected final long rightStateRetentionTime

joinCondition

protected transient JoinConditionWithNullFilters joinCondition

collector

protected transient TimestampedCollector<RowData> collector

Constructor Detail

AbstractStreamingJoinOperator

public AbstractStreamingJoinOperator(InternalTypeInfo<RowData> leftType,
                                     InternalTypeInfo<RowData> rightType,
                                     GeneratedJoinCondition generatedJoinCondition,
                                     JoinInputSideSpec leftInputSideSpec,
                                     JoinInputSideSpec rightInputSideSpec,
                                     boolean[] filterNullKeys,
                                     long leftStateRetentionTime,
                                     long rightStateRetentionTime)

Method Detail

open

public void open()
          throws Exception

Description copied from class: AbstractStreamOperator

This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

The default implementation does nothing.

Specified by:

open in interface StreamOperator<RowData>

Overrides:

open in class AbstractStreamOperator<RowData>

Throws:

Exception - An exception in this method causes the operator to fail.

close

public void close()
           throws Exception

Description copied from interface: StreamOperator

This method is called at the very end of the operator's life, both in the case of a successful completion of the operation, and in the case of a failure and canceling.

This method is expected to make a thorough effort to release all resources that the operator has acquired.

NOTE:It can not emit any records! If you need to emit records at the end of processing, do so in the StreamOperator.finish() method.

Specified by:

close in interface StreamOperator<RowData>

Overrides:

close in class AbstractStreamOperator<RowData>

Throws:

Exception