org.apache.flink.streaming.runtime.partitioner

Class RescalePartitioner<T>

java.lang.Object

org.apache.flink.streaming.runtime.partitioner.StreamPartitioner<T>

org.apache.flink.streaming.runtime.partitioner.RescalePartitioner<T>

Type Parameters:

T - Type of the elements in the Stream being rescaled

All Implemented Interfaces:

Serializable, ChannelSelector<SerializationDelegate<StreamRecord<T>>>

@Internal
public class RescalePartitioner<T>
extends StreamPartitioner<T>

Partitioner that distributes the data equally by cycling through the output channels. This distributes only to a subset of downstream nodes because StreamingJobGraphGenerator instantiates a DistributionPattern.POINTWISE distribution pattern when encountering SemiRebalancePartitioner.

The subset of downstream operations to which the upstream operation sends elements depends on the degree of parallelism of both the upstream and downstream operation. For example, if the upstream operation has parallelism 2 and the downstream operation has parallelism 4, then one upstream operation would distribute elements to two downstream operations while the other upstream operation would distribute to the other two downstream operations. If, on the other hand, the downstream operation has parallelism 2 while the upstream operation has parallelism 4 then two upstream operations will distribute to one downstream operation while the other two upstream operations will distribute to the other downstream operations.

In cases where the different parallelisms are not multiples of each other one or several downstream operations will have a differing number of inputs from upstream operations.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RescalePartitioner()

Method Summary

Modifier and Type	Method and Description
StreamPartitioner<T>	copy()
int[]	selectChannels(SerializationDelegate<StreamRecord<T>> record, int numberOfOutputChannels) Returns the logical channel indexes, to which the given record should be written.
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

RescalePartitioner

public RescalePartitioner()

Method Detail

selectChannels

public int[] selectChannels(SerializationDelegate<StreamRecord<T>> record,
                            int numberOfOutputChannels)

Description copied from interface: ChannelSelector

Returns the logical channel indexes, to which the given record should be written.

Parameters:

record - the record to the determine the output channels for

numberOfOutputChannels - the total number of output channels which are attached to respective output gate

Returns:

a (possibly empty) array of integer numbers which indicate the indices of the output channels through which the record shall be forwarded

copy

public StreamPartitioner<T> copy()

Specified by:

copy in class StreamPartitioner<T>

toString

public String toString()

Overrides:

toString in class Object