Modifier and Type | Method and Description |
---|---|
protected DataStream<T> |
KeyedStream.setConnectionType(StreamPartitioner<T> partitioner) |
protected DataStream<T> |
DataStream.setConnectionType(StreamPartitioner<T> partitioner)
Internal function for setting the partitioner for the DataStream.
|
Modifier and Type | Method and Description |
---|---|
StreamPartitioner<?> |
StreamEdge.getPartitioner() |
Modifier and Type | Method and Description |
---|---|
void |
StreamGraph.addVirtualPartitionNode(Integer originalId,
Integer virtualId,
StreamPartitioner<?> partitioner,
ShuffleMode shuffleMode)
Adds a new virtual node that is used to connect a downstream vertex to an input with a
certain partitioning.
|
void |
StreamEdge.setPartitioner(StreamPartitioner<?> partitioner) |
Constructor and Description |
---|
StreamEdge(StreamNode sourceVertex,
StreamNode targetVertex,
int typeNumber,
List<String> selectedNames,
StreamPartitioner<?> outputPartitioner,
OutputTag outputTag) |
StreamEdge(StreamNode sourceVertex,
StreamNode targetVertex,
int typeNumber,
List<String> selectedNames,
StreamPartitioner<?> outputPartitioner,
OutputTag outputTag,
ShuffleMode shuffleMode) |
StreamEdge(StreamNode sourceVertex,
StreamNode targetVertex,
int typeNumber,
long bufferTimeout,
List<String> selectedNames,
StreamPartitioner<?> outputPartitioner,
OutputTag outputTag,
ShuffleMode shuffleMode) |
Modifier and Type | Method and Description |
---|---|
StreamPartitioner<T> |
PartitionTransformation.getPartitioner()
Returns the
StreamPartitioner that must be used for partitioning the elements of the
input Transformation . |
Constructor and Description |
---|
PartitionTransformation(Transformation<T> input,
StreamPartitioner<T> partitioner)
Creates a new
PartitionTransformation from the given input and StreamPartitioner . |
PartitionTransformation(Transformation<T> input,
StreamPartitioner<T> partitioner,
ShuffleMode shuffleMode)
Creates a new
PartitionTransformation from the given input and StreamPartitioner . |
Modifier and Type | Class and Description |
---|---|
class |
BroadcastPartitioner<T>
Partitioner that selects all the output channels.
|
class |
CustomPartitionerWrapper<K,T>
Partitioner that selects the channel with a user defined partitioner function on a key.
|
class |
ForwardPartitioner<T>
Partitioner that forwards elements only to the locally running downstream operation.
|
class |
GlobalPartitioner<T>
Partitioner that sends all elements to the downstream operator with subtask ID=0.
|
class |
KeyGroupStreamPartitioner<T,K>
Partitioner selects the target channel based on the key group index.
|
class |
RebalancePartitioner<T>
Partitioner that distributes the data equally by cycling through the output channels.
|
class |
RescalePartitioner<T>
Partitioner that distributes the data equally by cycling through the output channels.
|
class |
ShufflePartitioner<T>
Partitioner that distributes the data equally by selecting one output channel randomly.
|
Modifier and Type | Method and Description |
---|---|
StreamPartitioner<T> |
ShufflePartitioner.copy() |
StreamPartitioner<T> |
RescalePartitioner.copy() |
StreamPartitioner<T> |
BroadcastPartitioner.copy() |
StreamPartitioner<T> |
CustomPartitionerWrapper.copy() |
abstract StreamPartitioner<T> |
StreamPartitioner.copy() |
StreamPartitioner<T> |
ForwardPartitioner.copy() |
StreamPartitioner<T> |
RebalancePartitioner.copy() |
StreamPartitioner<T> |
GlobalPartitioner.copy() |
StreamPartitioner<T> |
KeyGroupStreamPartitioner.copy() |
Modifier and Type | Class and Description |
---|---|
class |
BinaryHashPartitioner
Hash partitioner for
BinaryRowData . |
Modifier and Type | Method and Description |
---|---|
StreamPartitioner<RowData> |
BinaryHashPartitioner.copy() |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.