INPUT - The type of input record.@Internal public class SortPartitionOperator<INPUT> extends AbstractStreamOperator<INPUT> implements OneInputStreamOperator<INPUT,INPUT>, BoundedOneInput
SortPartitionOperator sorts records of a partition on non-keyed data stream. It
ensures that all records within the same task are sorted in a user-defined order.
To sort the records, the record will be written to ExternalSorter directly. However,
if the record is sorted according to the selected key by KeySelector, the selected key
should also be written with the record to ExternalSorter to avoid repeated key
selections.
| Modifier and Type | Field and Description |
|---|---|
protected TypeInformation<INPUT> |
inputType
The type information of input records.
|
protected KeySelector<INPUT,?> |
sortFieldSelector
The selector to create the sort key for records, which will be null if it's not used.
|
chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager| Constructor and Description |
|---|
SortPartitionOperator(TypeInformation<INPUT> inputType,
int positionSortField,
Order sortOrder) |
SortPartitionOperator(TypeInformation<INPUT> inputType,
KeySelector<INPUT,K> sortFieldSelector,
Order sortOrder) |
SortPartitionOperator(TypeInformation<INPUT> inputType,
String stringSortField,
Order sortOrder) |
| Modifier and Type | Method and Description |
|---|---|
void |
endInput()
It is notified that no more data will arrive from the input.
|
OperatorAttributes |
getOperatorAttributes()
Called to get the OperatorAttributes of the operator.
|
void |
processElement(StreamRecord<INPUT> element)
Processes one element that arrived on this input of the
MultipleInputStreamOperator. |
void |
setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<INPUT>> output)
Initializes the operator.
|
close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, snapshotState, snapshotState, useSplittableTimersclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitsetKeyContextElementclose, finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotStatenotifyCheckpointAborted, notifyCheckpointCompletegetCurrentKey, setCurrentKeyprocessLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatushasKeyContextprotected final TypeInformation<INPUT> inputType
protected final KeySelector<INPUT,?> sortFieldSelector
public SortPartitionOperator(TypeInformation<INPUT> inputType, int positionSortField, Order sortOrder)
public SortPartitionOperator(TypeInformation<INPUT> inputType, String stringSortField, Order sortOrder)
public SortPartitionOperator(TypeInformation<INPUT> inputType, KeySelector<INPUT,K> sortFieldSelector, Order sortOrder)
public void setup(StreamTask<?,?> containingTask, StreamConfig config, Output<StreamRecord<INPUT>> output)
SetupableStreamOperatorsetup in interface SetupableStreamOperator<INPUT>setup in class AbstractStreamOperator<INPUT>public void processElement(StreamRecord<INPUT> element) throws Exception
InputMultipleInputStreamOperator.
This method is guaranteed to not be called concurrently with other methods of the operator.processElement in interface Input<INPUT>Exceptionpublic void endInput()
throws Exception
BoundedOneInputWARNING: It is not safe to use this method to commit any transactions or other side
effects! You can use this method to flush any buffered data that can later on be committed
e.g. in a CheckpointListener.notifyCheckpointComplete(long).
NOTE: Given it is semantically very similar to the StreamOperator.finish()
method. It might be dropped in favour of the other method at some point in time.
endInput in interface BoundedOneInputExceptionpublic OperatorAttributes getOperatorAttributes()
StreamOperatorgetOperatorAttributes in interface StreamOperator<INPUT>Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.