INPUT - The type of input record.KEY - The type of record key, which has already been defined in KeyedStream.@Internal public class KeyedSortPartitionOperator<INPUT,KEY> extends AbstractStreamOperator<INPUT> implements OneInputStreamOperator<INPUT,INPUT>, BoundedOneInput
KeyedSortPartitionOperator sorts records of a partition on KeyedStream. It
ensures that all records with the same key are sorted in a user-defined order.
To sort the record key first and then record at the same time, both the record key and the
record will be written to ExternalSorter directly. However, if the record is sorted
according to the selected key by KeySelector, the selected sort key should also be
written with the record key and the record to ExternalSorter to avoid repeated key
selections.
| Modifier and Type | Field and Description |
|---|---|
protected TypeInformation<INPUT> |
inputType
The type information of input records.
|
protected KeySelector<INPUT,?> |
sortFieldSelector
The selector to create the sort key for records, which will be null if it's not used.
|
chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager| Constructor and Description |
|---|
KeyedSortPartitionOperator(TypeInformation<INPUT> inputType,
int positionSortField,
Order sortOrder) |
KeyedSortPartitionOperator(TypeInformation<INPUT> inputType,
KeySelector<INPUT,K> sortFieldSelector,
Order sortOrder) |
KeyedSortPartitionOperator(TypeInformation<INPUT> inputType,
String stringSortField,
Order sortOrder) |
| Modifier and Type | Method and Description |
|---|---|
void |
endInput()
It is notified that no more data will arrive from the input.
|
OperatorAttributes |
getOperatorAttributes()
Called to get the OperatorAttributes of the operator.
|
void |
processElement(StreamRecord<INPUT> element)
Processes one element that arrived on this input of the
MultipleInputStreamOperator. |
void |
setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<INPUT>> output)
Initializes the operator.
|
close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, snapshotState, snapshotState, useSplittableTimersclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitsetKeyContextElementclose, finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotStatenotifyCheckpointAborted, notifyCheckpointCompletegetCurrentKey, setCurrentKeyprocessLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatushasKeyContextprotected final TypeInformation<INPUT> inputType
protected final KeySelector<INPUT,?> sortFieldSelector
public KeyedSortPartitionOperator(TypeInformation<INPUT> inputType, int positionSortField, Order sortOrder)
public KeyedSortPartitionOperator(TypeInformation<INPUT> inputType, String stringSortField, Order sortOrder)
public KeyedSortPartitionOperator(TypeInformation<INPUT> inputType, KeySelector<INPUT,K> sortFieldSelector, Order sortOrder)
public void setup(StreamTask<?,?> containingTask, StreamConfig config, Output<StreamRecord<INPUT>> output)
SetupableStreamOperatorsetup in interface SetupableStreamOperator<INPUT>setup in class AbstractStreamOperator<INPUT>public void processElement(StreamRecord<INPUT> element) throws Exception
InputMultipleInputStreamOperator.
This method is guaranteed to not be called concurrently with other methods of the operator.processElement in interface Input<INPUT>Exceptionpublic void endInput()
throws Exception
BoundedOneInputWARNING: It is not safe to use this method to commit any transactions or other side
effects! You can use this method to flush any buffered data that can later on be committed
e.g. in a CheckpointListener.notifyCheckpointComplete(long).
NOTE: Given it is semantically very similar to the StreamOperator.finish()
method. It might be dropped in favour of the other method at some point in time.
endInput in interface BoundedOneInputExceptionpublic OperatorAttributes getOperatorAttributes()
StreamOperatorgetOperatorAttributes in interface StreamOperator<INPUT>Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.