org.apache.flink.ml.common.datastream.sort

Class CoGroupOperator<IN1,IN2,KEY extends Serializable,OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT>>

org.apache.flink.ml.common.datastream.sort.CoGroupOperator<IN1,IN2,KEY,OUT>

Type Parameters:

IN1 - The class type of the first input.

IN2 - The class type of the second input.

KEY - The class type of the key.

OUT - The class type of the output values.

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedMultiInput, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>

public class CoGroupOperator<IN1,IN2,KEY extends Serializable,OUT>
extends org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT>>
implements org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>, org.apache.flink.streaming.api.operators.BoundedMultiInput

An operator that implements the co-group logic.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

userFunction

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

Constructor Summary

Constructors

Constructor and Description
CoGroupOperator(org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT> function)

Method Summary

Modifier and Type	Method and Description
void	close()
void	endInput(int inputId)
void	processElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> streamRecord)
void	processElement2(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN2> streamRecord)
void	processWatermark(org.apache.flink.streaming.api.watermark.Watermark watermark)
void	setup(org.apache.flink.streaming.runtime.tasks.StreamTask<?,?> containingTask, org.apache.flink.streaming.api.graph.StreamConfig config, org.apache.flink.streaming.api.operators.Output<org.apache.flink.streaming.runtime.streamrecord.StreamRecord<OUT>> output)

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator

finish, getUserFunction, getUserFunctionParameters, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, open, setOutputType, snapshotState

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, snapshotState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator

processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

Constructor Detail

CoGroupOperator

public CoGroupOperator(org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT> function)

Method Detail

setup

public void setup(org.apache.flink.streaming.runtime.tasks.StreamTask<?,?> containingTask,
                  org.apache.flink.streaming.api.graph.StreamConfig config,
                  org.apache.flink.streaming.api.operators.Output<org.apache.flink.streaming.runtime.streamrecord.StreamRecord<OUT>> output)

Specified by:

setup in interface org.apache.flink.streaming.api.operators.SetupableStreamOperator<OUT>

Overrides:

setup in class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT>>

endInput

public void endInput(int inputId)
              throws Exception

Specified by:

endInput in interface org.apache.flink.streaming.api.operators.BoundedMultiInput

Throws:

Exception

processWatermark

public void processWatermark(org.apache.flink.streaming.api.watermark.Watermark watermark)
                      throws Exception

Overrides:

processWatermark in class org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.streaming.api.operators.StreamOperator<OUT>

Overrides:

close in class org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.CoGroupFunction<IN1,IN2,OUT>>

Throws:

Exception

processElement1

public void processElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN1> streamRecord)
                     throws Exception

Specified by:

processElement1 in interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>

Throws:

Exception

processElement2

public void processElement2(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN2> streamRecord)
                     throws Exception

Specified by:

processElement2 in interface org.apache.flink.streaming.api.operators.TwoInputStreamOperator<IN1,IN2,OUT>

Throws:

Exception