org.apache.flink.optimizer.dag

Class SinkJoiner

java.lang.Object

org.apache.flink.optimizer.dag.OptimizerNode

org.apache.flink.optimizer.dag.TwoInputNode

org.apache.flink.optimizer.dag.SinkJoiner

All Implemented Interfaces:

EstimateProvider, DumpableNode<OptimizerNode>, Visitable<OptimizerNode>

public class SinkJoiner
extends TwoInputNode

This class represents a utility node that is not part of the actual plan. It is used for plans with multiple data sinks to transform it into a plan with a single root node. That way, the code that makes sure no costs are double-counted and that candidate selection works correctly with nodes that have multiple outputs is transparently reused.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.optimizer.dag.OptimizerNode

OptimizerNode.UnclosedBranchDescriptor

Field Summary

Fields inherited from class org.apache.flink.optimizer.dag.TwoInputNode

input1, input2, keys1, keys2

Fields inherited from class org.apache.flink.optimizer.dag.OptimizerNode

cachedPlans, closedBranchingNodes, costWeight, estimatedNumRecords, estimatedOutputSize, hereJoinedBranches, id, MAX_DYNAMIC_PATH_COST_WEIGHT, onDynamicPath, openBranches, uniqueFields

Constructor Summary

Constructors

Constructor and Description
SinkJoiner(OptimizerNode input1, OptimizerNode input2)

Method Summary

Modifier and Type	Method and Description
protected void	computeOperatorSpecificDefaultEstimates(DataStatistics statistics)
void	computeOutputEstimates(DataStatistics statistics) Causes this node to compute its output estimates (such as number of rows, size in bytes) based on the inputs and the compiler hints.
void	computeUnclosedBranchStack() This method causes the node to compute the description of open branches in its sub-plan.
String	getOperatorName() Gets the name of this node, which is the name of the function/operator, or data source / data sink.
List<DagConnection>	getOutgoingConnections() The list of outgoing connections from this node to succeeding tasks.
protected List<OperatorDescriptorDual>	getPossibleProperties()

Methods inherited from class org.apache.flink.optimizer.dag.TwoInputNode

accept, addLocalCandidates, computeInterestingPropertiesForInputs, getAlternativePlans, getFirstIncomingConnection, getFirstPredecessorNode, getIncomingConnections, getOperator, getSecondIncomingConnection, getSecondPredecessorNode, getSemanticProperties, getSemanticPropertiesForGlobalPropertyFiltering, getSemanticPropertiesForLocalPropertyFiltering, instantiate, placePipelineBreakersIfNecessary, setInput

Methods inherited from class org.apache.flink.optimizer.dag.OptimizerNode

addBroadcastConnection, addClosedBranch, addClosedBranches, addOutgoingConnection, areBranchCompatible, clearInterestingProperties, computeUnclosedBranchStackForBroadcastInputs, computeUnionOfInterestingPropertiesFromSuccessors, getBranchesForParent, getBroadcastConnectionNames, getBroadcastConnections, getClosedBranchingNodes, getCostWeight, getDumpableInputs, getEstimatedAvgWidthPerOutputRecord, getEstimatedNumRecords, getEstimatedOutputSize, getId, getInterestingProperties, getMaxDepth, getMinimalMemoryAcrossAllSubTasks, getOpenBranches, getOptimizerNode, getParallelism, getPlanNode, getPredecessors, getUniqueFields, hasUnclosedBranches, haveAllOutputConnectionInterestingProperties, identifyDynamicPath, initId, isBranching, isOnDynamicPath, markAllOutgoingConnectionsAsPipelineBreaking, mergeLists, prunePlanAlternatives, prunePlanAlternativesWithCommonBranching, readStubAnnotations, readUniqueFieldsAnnotation, removeClosedBranches, setBroadcastInputs, setEstimatedNumRecords, setEstimatedOutputSize, setParallelism, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SinkJoiner

public SinkJoiner(OptimizerNode input1,
                  OptimizerNode input2)

Method Detail

getOperatorName

public String getOperatorName()

Description copied from class: OptimizerNode

Gets the name of this node, which is the name of the function/operator, or data source / data sink.

Specified by:

getOperatorName in class OptimizerNode

Returns:

The node name.

getOutgoingConnections

public List<DagConnection> getOutgoingConnections()

Description copied from class: OptimizerNode

The list of outgoing connections from this node to succeeding tasks.

Overrides:

getOutgoingConnections in class OptimizerNode

Returns:

The list of outgoing connections.

computeUnclosedBranchStack

public void computeUnclosedBranchStack()

Description copied from class: OptimizerNode

This method causes the node to compute the description of open branches in its sub-plan. An open branch describes, that a (transitive) child node had multiple outputs, which have not all been re-joined in the sub-plan. This method needs to set the openBranches field to a stack of unclosed branches, the latest one top. A branch is considered closed, if some later node sees all of the branching node's outputs, no matter if there have been more branches to different paths in the meantime.

Overrides:

computeUnclosedBranchStack in class TwoInputNode

getPossibleProperties

protected List<OperatorDescriptorDual> getPossibleProperties()

Specified by:

getPossibleProperties in class TwoInputNode

computeOutputEstimates

public void computeOutputEstimates(DataStatistics statistics)

Description copied from class: OptimizerNode

Causes this node to compute its output estimates (such as number of rows, size in bytes) based on the inputs and the compiler hints. The compiler hints are instantiated with conservative default values which are used if no other values are provided. Nodes may access the statistics to determine relevant information.

Overrides:

computeOutputEstimates in class OptimizerNode

Parameters:

statistics - The statistics object which may be accessed to get statistical information. The parameter may be null, if no statistics are available.

computeOperatorSpecificDefaultEstimates

protected void computeOperatorSpecificDefaultEstimates(DataStatistics statistics)

Specified by:

computeOperatorSpecificDefaultEstimates in class OptimizerNode