public class StreamExecMiniBatchAssigner extends ExecNodeBase<RowData> implements StreamExecNode<RowData>, SingleTransformationTranslator<RowData>
ExecNode
which injects a mini-batch event in the streaming data. The mini-batch
event will be recognized as a boundary between two mini-batches. The following operators will
keep track of the mini-batch events and trigger mini-batch once the mini-batch id is advanced.
NOTE: currently, we leverage the runtime watermark mechanism to achieve the mini-batch, because runtime doesn't support customized events and the watermark mechanism fully meets mini-batch needs.
Modifier and Type | Field and Description |
---|---|
static String |
FIELD_NAME_MINI_BATCH_INTERVAL |
FIELD_NAME_DESCRIPTION, FIELD_NAME_ID, FIELD_NAME_INPUT_PROPERTIES, FIELD_NAME_OUTPUT_TYPE
Constructor and Description |
---|
StreamExecMiniBatchAssigner(MiniBatchInterval miniBatchInterval,
InputProperty inputProperty,
RowType outputType,
String description) |
StreamExecMiniBatchAssigner(MiniBatchInterval miniBatchInterval,
int id,
List<InputProperty> inputProperties,
RowType outputType,
String description) |
Modifier and Type | Method and Description |
---|---|
protected Transformation<RowData> |
translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner)
Internal method, translates this node into a Flink operator.
|
accept, getDescription, getId, getInputEdges, getInputProperties, getNewNodeId, getOutputType, inputsContainSingleton, replaceInputEdge, resetIdCounter, setInputEdges, translateToPlan
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
accept, getDescription, getId, getInputEdges, getInputProperties, getOutputType, replaceInputEdge, setInputEdges
translateToPlan
public static final String FIELD_NAME_MINI_BATCH_INTERVAL
public StreamExecMiniBatchAssigner(MiniBatchInterval miniBatchInterval, InputProperty inputProperty, RowType outputType, String description)
public StreamExecMiniBatchAssigner(MiniBatchInterval miniBatchInterval, int id, List<InputProperty> inputProperties, RowType outputType, String description)
protected Transformation<RowData> translateToPlanInternal(org.apache.flink.table.planner.delegation.PlannerBase planner)
ExecNodeBase
translateToPlanInternal
in class ExecNodeBase<RowData>
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.