@Public public class JoinedStreams<T1,T2> extends Object
JoinedStreams
represents two DataStreams
that have been joined.
A streaming join operation is evaluated over elements in a window.
To finalize the join operation you also need to specify a KeySelector
for
both the first and second input and a WindowAssigner
.
Note: Right now, the join is being evaluated in memory so you need to ensure that the number of elements per key does not get too high. Otherwise the JVM might crash.
Example:
DataStream<Tuple2<String, Integer>> one = ...;
DataStream<Tuple2<String, Integer>> twp = ...;
DataStream<T> result = one.join(two)
.where(new MyFirstKeySelector())
.equalTo(new MyFirstKeySelector())
.window(TumblingEventTimeWindows.of(Time.of(5, TimeUnit.SECONDS)))
.apply(new MyJoinFunction());
Modifier and Type | Class and Description |
---|---|
class |
JoinedStreams.Where<KEY>
Joined streams that have the key for one side defined.
|
static class |
JoinedStreams.WithWindow<T1,T2,KEY,W extends Window>
A join operation that has
KeySelectors defined for both inputs as
well as a WindowAssigner . |
Constructor and Description |
---|
JoinedStreams(DataStream<T1> input1,
DataStream<T2> input2)
Creates new JoinedStreams data streams, which are the first step towards building a streaming co-group.
|
Modifier and Type | Method and Description |
---|---|
<KEY> JoinedStreams.Where<KEY> |
where(KeySelector<T1,KEY> keySelector)
Specifies a
KeySelector for elements from the first input. |
public JoinedStreams(DataStream<T1> input1, DataStream<T2> input2)
input1
- The first data stream.input2
- The second data stream.public <KEY> JoinedStreams.Where<KEY> where(KeySelector<T1,KEY> keySelector)
KeySelector
for elements from the first input.Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.