Modifier and Type | Method and Description |
---|---|
<R> DataStream<R> |
PatternStream.flatSelect(PatternFlatSelectFunction<T,R> patternFlatSelectFunction)
Applies a flat select function to the detected pattern sequence.
|
<R> DataStream<R> |
PatternStream.flatSelect(PatternFlatSelectFunction<T,R> patternFlatSelectFunction,
TypeInformation<R> outTypeInfo)
Applies a flat select function to the detected pattern sequence.
|
<L,R> DataStream<Either<L,R>> |
PatternStream.flatSelect(PatternFlatTimeoutFunction<T,L> patternFlatTimeoutFunction,
PatternFlatSelectFunction<T,R> patternFlatSelectFunction)
Applies a flat select function to the detected pattern sequence.
|
DataStream<T> |
PatternStream.getInputStream() |
<R> DataStream<R> |
PatternStream.select(PatternSelectFunction<T,R> patternSelectFunction)
Applies a select function to the detected pattern sequence.
|
<R> DataStream<R> |
PatternStream.select(PatternSelectFunction<T,R> patternSelectFunction,
TypeInformation<R> outTypeInfo)
Applies a select function to the detected pattern sequence.
|
<L,R> DataStream<Either<L,R>> |
PatternStream.select(PatternTimeoutFunction<T,L> patternTimeoutFunction,
PatternSelectFunction<T,R> patternSelectFunction)
Applies a select function to the detected pattern sequence.
|
Modifier and Type | Method and Description |
---|---|
static <T> PatternStream<T> |
CEP.pattern(DataStream<T> input,
Pattern<T,?> pattern)
Creates a
PatternStream from an input data stream and a pattern. |
Modifier and Type | Method and Description |
---|---|
static <K,T> DataStream<Map<String,T>> |
CEPOperatorUtils.createPatternStream(DataStream<T> inputStream,
Pattern<T,?> pattern)
Creates a data stream containing the fully matching event patterns of the NFA computation.
|
static <K,T> DataStream<Either<Tuple2<Map<String,T>,Long>,Map<String,T>>> |
CEPOperatorUtils.createTimeoutPatternStream(DataStream<T> inputStream,
Pattern<T,?> pattern)
Creates a data stream containing fully matching event patterns or partially matching event
patterns which have timed out.
|
Modifier and Type | Method and Description |
---|---|
static <K,T> DataStream<Map<String,T>> |
CEPOperatorUtils.createPatternStream(DataStream<T> inputStream,
Pattern<T,?> pattern)
Creates a data stream containing the fully matching event patterns of the NFA computation.
|
static <K,T> DataStream<Either<Tuple2<Map<String,T>,Long>,Map<String,T>>> |
CEPOperatorUtils.createTimeoutPatternStream(DataStream<T> inputStream,
Pattern<T,?> pattern)
Creates a data stream containing fully matching event patterns or partially matching event
patterns which have timed out.
|
Modifier and Type | Method and Description |
---|---|
static <OUT> Iterator<OUT> |
DataStreamUtils.collect(DataStream<OUT> stream)
Returns an iterator to iterate over the elements of the DataStream.
|
Modifier and Type | Class and Description |
---|---|
class |
DataStreamSource<T>
The DataStreamSource represents the starting point of a DataStream.
|
class |
IterativeStream<T>
The iterative data stream represents the start of an iteration in a
DataStream . |
class |
KeyedStream<T,KEY>
A
KeyedStream represents a DataStream on which operator state is
partitioned by key using a provided KeySelector . |
class |
SingleOutputStreamOperator<T>
SingleOutputStreamOperator represents a user defined transformation
applied on a DataStream with one predefined output type. |
class |
SplitStream<OUT>
The SplitStream represents an operator that has been split using an
OutputSelector . |
Modifier and Type | Field and Description |
---|---|
protected DataStream<IN1> |
ConnectedStreams.inputStream1 |
protected DataStream<IN2> |
ConnectedStreams.inputStream2 |
Modifier and Type | Method and Description |
---|---|
<T> DataStream<T> |
CoGroupedStreams.WithWindow.apply(CoGroupFunction<T1,T2,T> function)
Completes the co-group operation with the user function that is executed
for windowed groups.
|
<T> DataStream<T> |
CoGroupedStreams.WithWindow.apply(CoGroupFunction<T1,T2,T> function,
TypeInformation<T> resultType)
Completes the co-group operation with the user function that is executed
for windowed groups.
|
<T> DataStream<T> |
JoinedStreams.WithWindow.apply(FlatJoinFunction<T1,T2,T> function)
Completes the join operation with the user function that is executed
for each combination of elements with the same key in a window.
|
<T> DataStream<T> |
JoinedStreams.WithWindow.apply(FlatJoinFunction<T1,T2,T> function,
TypeInformation<T> resultType)
Completes the join operation with the user function that is executed
for each combination of elements with the same key in a window.
|
<T> DataStream<T> |
JoinedStreams.WithWindow.apply(JoinFunction<T1,T2,T> function)
Completes the join operation with the user function that is executed
for each combination of elements with the same key in a window.
|
<T> DataStream<T> |
JoinedStreams.WithWindow.apply(JoinFunction<T1,T2,T> function,
TypeInformation<T> resultType)
Completes the join operation with the user function that is executed
for each combination of elements with the same key in a window.
|
DataStream<T> |
DataStream.broadcast()
Sets the partitioning of the
DataStream so that the output elements
are broadcasted to every parallel instance of the next operation. |
DataStream<F> |
IterativeStream.ConnectedIterativeStreams.closeWith(DataStream<F> feedbackStream)
Closes the iteration.
|
DataStream<T> |
IterativeStream.closeWith(DataStream<T> feedbackStream)
Closes the iteration.
|
DataStream<T> |
DataStream.forward()
Sets the partitioning of the
DataStream so that the output elements
are forwarded to the local subtask of the next operation. |
DataStream<IN1> |
ConnectedStreams.getFirstInput()
Returns the first
DataStream . |
DataStream<IN2> |
ConnectedStreams.getSecondInput()
Returns the second
DataStream . |
DataStream<T> |
DataStream.global()
Sets the partitioning of the
DataStream so that the output values
all go to the first instance of the next processing operator. |
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
int field)
Partitions a tuple DataStream on the specified key fields using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
KeySelector<T,K> keySelector)
Partitions a DataStream on the key returned by the selector, using a custom partitioner.
|
<K> DataStream<T> |
DataStream.partitionCustom(Partitioner<K> partitioner,
String field)
Partitions a POJO DataStream on the specified key fields using a custom partitioner.
|
DataStream<T> |
DataStream.rebalance()
Sets the partitioning of the
DataStream so that the output elements
are distributed evenly to instances of the next operation in a round-robin
fashion. |
DataStream<T> |
DataStream.rescale()
Sets the partitioning of the
DataStream so that the output elements
are distributed evenly to a subset of instances of the next operation in a round-robin
fashion. |
DataStream<OUT> |
SplitStream.select(String... outputNames)
Sets the output names for which the next operator will receive values.
|
protected DataStream<T> |
SingleOutputStreamOperator.setConnectionType(StreamPartitioner<T> partitioner) |
protected DataStream<T> |
KeyedStream.setConnectionType(StreamPartitioner<T> partitioner) |
protected DataStream<T> |
DataStream.setConnectionType(StreamPartitioner<T> partitioner)
Internal function for setting the partitioner for the DataStream
|
DataStream<T> |
DataStream.shuffle()
Sets the partitioning of the
DataStream so that the output elements
are shuffled uniformly randomly to the next operation. |
DataStream<T> |
DataStream.union(DataStream<T>... streams)
Creates a new
DataStream by merging DataStream outputs of
the same type with each other. |
Modifier and Type | Method and Description |
---|---|
DataStream<F> |
IterativeStream.ConnectedIterativeStreams.closeWith(DataStream<F> feedbackStream)
Closes the iteration.
|
DataStream<T> |
IterativeStream.closeWith(DataStream<T> feedbackStream)
Closes the iteration.
|
<T2> CoGroupedStreams<T,T2> |
DataStream.coGroup(DataStream<T2> otherStream)
Creates a join operation.
|
<R> ConnectedStreams<T,R> |
DataStream.connect(DataStream<R> dataStream)
Creates a new
ConnectedStreams by connecting
DataStream outputs of (possible) different types with each other. |
<T2> JoinedStreams<T,T2> |
DataStream.join(DataStream<T2> otherStream)
Creates a join operation.
|
static <IN,OUT> SingleOutputStreamOperator<OUT> |
AsyncDataStream.orderedWait(DataStream<IN> in,
AsyncFunction<IN,OUT> func,
long timeout,
TimeUnit timeUnit)
Add an AsyncWaitOperator.
|
static <IN,OUT> SingleOutputStreamOperator<OUT> |
AsyncDataStream.orderedWait(DataStream<IN> in,
AsyncFunction<IN,OUT> func,
long timeout,
TimeUnit timeUnit,
int capacity)
Add an AsyncWaitOperator.
|
DataStream<T> |
DataStream.union(DataStream<T>... streams)
Creates a new
DataStream by merging DataStream outputs of
the same type with each other. |
static <IN,OUT> SingleOutputStreamOperator<OUT> |
AsyncDataStream.unorderedWait(DataStream<IN> in,
AsyncFunction<IN,OUT> func,
long timeout,
TimeUnit timeUnit)
Add an AsyncWaitOperator.
|
static <IN,OUT> SingleOutputStreamOperator<OUT> |
AsyncDataStream.unorderedWait(DataStream<IN> in,
AsyncFunction<IN,OUT> func,
long timeout,
TimeUnit timeUnit,
int capacity)
Add an AsyncWaitOperator.
|
Constructor and Description |
---|
AllWindowedStream(DataStream<T> input,
WindowAssigner<? super T,W> windowAssigner) |
CoGroupedStreams(DataStream<T1> input1,
DataStream<T2> input2)
Creates new CoGroped data streams, which are the first step towards building a streaming co-group.
|
CoGroupedStreams(DataStream<T1> input1,
DataStream<T2> input2)
Creates new CoGroped data streams, which are the first step towards building a streaming co-group.
|
ConnectedIterativeStreams(DataStream<I> input,
TypeInformation<F> feedbackType,
long waitTime) |
ConnectedStreams(StreamExecutionEnvironment env,
DataStream<IN1> input1,
DataStream<IN2> input2) |
ConnectedStreams(StreamExecutionEnvironment env,
DataStream<IN1> input1,
DataStream<IN2> input2) |
DataStreamSink(DataStream<T> inputStream,
StreamSink<T> operator) |
IterativeStream(DataStream<T> dataStream,
long maxWaitTime) |
JoinedStreams(DataStream<T1> input1,
DataStream<T2> input2)
Creates new JoinedStreams data streams, which are the first step towards building a streaming co-group.
|
JoinedStreams(DataStream<T1> input1,
DataStream<T2> input2)
Creates new JoinedStreams data streams, which are the first step towards building a streaming co-group.
|
KeyedStream(DataStream<T> dataStream,
KeySelector<T,KEY> keySelector)
Creates a new
KeyedStream using the given KeySelector
to partition operator state by key. |
KeyedStream(DataStream<T> dataStream,
KeySelector<T,KEY> keySelector,
TypeInformation<KEY> keyType)
Creates a new
KeyedStream using the given KeySelector
to partition operator state by key. |
SplitStream(DataStream<OUT> dataStream,
OutputSelector<OUT> outputSelector) |
StreamProjection(DataStream<IN> dataStream,
int[] fieldIndexes) |
WithWindow(DataStream<T1> input1,
DataStream<T2> input2,
KeySelector<T1,KEY> keySelector1,
KeySelector<T2,KEY> keySelector2,
TypeInformation<KEY> keyType,
WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner,
Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger,
Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor) |
WithWindow(DataStream<T1> input1,
DataStream<T2> input2,
KeySelector<T1,KEY> keySelector1,
KeySelector<T2,KEY> keySelector2,
TypeInformation<KEY> keyType,
WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner,
Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger,
Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor) |
WithWindow(DataStream<T1> input1,
DataStream<T2> input2,
KeySelector<T1,KEY> keySelector1,
KeySelector<T2,KEY> keySelector2,
TypeInformation<KEY> keyType,
WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner,
Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger,
Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor) |
WithWindow(DataStream<T1> input1,
DataStream<T2> input2,
KeySelector<T1,KEY> keySelector1,
KeySelector<T2,KEY> keySelector2,
TypeInformation<KEY> keyType,
WindowAssigner<? super CoGroupedStreams.TaggedUnion<T1,T2>,W> windowAssigner,
Trigger<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> trigger,
Evictor<? super CoGroupedStreams.TaggedUnion<T1,T2>,? super W> evictor) |
Modifier and Type | Method and Description |
---|---|
DataStream<String> |
StreamExecutionEnvironment.readFileStream(String filePath,
long intervalMillis,
FileMonitoringFunction.WatchType watchType)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
DataStream<T> |
DataStream.javaStream()
Gets the underlying java DataStream object.
|
Constructor and Description |
---|
DataStream(DataStream<T> stream) |
Modifier and Type | Field and Description |
---|---|
protected DataStream<IN> |
CassandraSink.CassandraSinkBuilder.input |
Modifier and Type | Method and Description |
---|---|
static <IN,T extends Tuple> |
CassandraSink.addSink(DataStream<IN> input)
Writes a DataStream into a Cassandra database.
|
Constructor and Description |
---|
CassandraPojoSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
CassandraTupleSinkBuilder(DataStream<IN> input,
TypeInformation<IN> typeInfo,
TypeSerializer<IN> serializer) |
Modifier and Type | Method and Description |
---|---|
DataStream<Row> |
KafkaTableSource.getDataStream(StreamExecutionEnvironment env)
NOTE: This method is for internal use only for defining a TableSource.
|
Modifier and Type | Method and Description |
---|---|
void |
KafkaTableSink.emitDataStream(DataStream<Row> dataStream) |
static <T> FlinkKafkaProducer010.FlinkKafkaProducer010Configuration<T> |
FlinkKafkaProducer010.writeToKafkaWithTimestamps(DataStream<T> inStream,
String topicId,
KeyedSerializationSchema<T> serializationSchema,
Properties producerConfig)
Creates a FlinkKafkaProducer for a given topic.
|
static <T> FlinkKafkaProducer010.FlinkKafkaProducer010Configuration<T> |
FlinkKafkaProducer010.writeToKafkaWithTimestamps(DataStream<T> inStream,
String topicId,
KeyedSerializationSchema<T> serializationSchema,
Properties producerConfig,
KafkaPartitioner<T> customPartitioner)
Creates a FlinkKafkaProducer for a given topic.
|
static <T> FlinkKafkaProducer010.FlinkKafkaProducer010Configuration<T> |
FlinkKafkaProducer010.writeToKafkaWithTimestamps(DataStream<T> inStream,
String topicId,
SerializationSchema<T> serializationSchema,
Properties producerConfig)
Creates a FlinkKafkaProducer for a given topic.
|
Modifier and Type | Method and Description |
---|---|
static DataStream<Tuple2<String,Integer>> |
WindowJoinSampleData.GradeSource.getSource(StreamExecutionEnvironment env,
long rate) |
static DataStream<Tuple2<String,Integer>> |
WindowJoinSampleData.SalarySource.getSource(StreamExecutionEnvironment env,
long rate) |
static DataStream<Tuple3<String,Integer,Integer>> |
WindowJoin.runWindowJoin(DataStream<Tuple2<String,Integer>> grades,
DataStream<Tuple2<String,Integer>> salaries,
long windowSize) |
Modifier and Type | Method and Description |
---|---|
static DataStream<Tuple3<String,Integer,Integer>> |
WindowJoin.runWindowJoin(DataStream<Tuple2<String,Integer>> grades,
DataStream<Tuple2<String,Integer>> salaries,
long windowSize) |
static DataStream<Tuple3<String,Integer,Integer>> |
WindowJoin.runWindowJoin(DataStream<Tuple2<String,Integer>> grades,
DataStream<Tuple2<String,Integer>> salaries,
long windowSize) |
Modifier and Type | Method and Description |
---|---|
protected <A> DataStream<A> |
StreamTableEnvironment.translate(org.apache.calcite.rel.RelNode logicalPlan,
TypeInformation<A> tpe)
Translates a logical
RelNode into a DataStream . |
protected <A> DataStream<A> |
StreamTableEnvironment.translate(Table table,
TypeInformation<A> tpe)
Translates a
Table into a DataStream . |
Modifier and Type | Method and Description |
---|---|
protected <T> void |
StreamTableEnvironment.registerDataStreamInternal(String name,
DataStream<T> dataStream)
Registers a
DataStream as a table under a given name in the TableEnvironment 's
catalog. |
protected <T> void |
StreamTableEnvironment.registerDataStreamInternal(String name,
DataStream<T> dataStream,
Expression[] fields)
Registers a
DataStream as a table under a given name with field names as specified by
field expressions in the TableEnvironment 's catalog. |
Modifier and Type | Method and Description |
---|---|
<T> DataStream<T> |
StreamTableEnvironment.toDataStream(Table table,
Class<T> clazz)
Converts the given
Table into a DataStream of a specified type. |
<T> DataStream<T> |
StreamTableEnvironment.toDataStream(Table table,
TypeInformation<T> typeInfo)
Converts the given
Table into a DataStream of a specified type. |
Modifier and Type | Method and Description |
---|---|
<T> Table |
StreamTableEnvironment.fromDataStream(DataStream<T> dataStream)
Converts the given
DataStream into a Table . |
<T> Table |
StreamTableEnvironment.fromDataStream(DataStream<T> dataStream,
String fields)
Converts the given
DataStream into a Table with specified field names. |
<T> void |
StreamTableEnvironment.registerDataStream(String name,
DataStream<T> dataStream)
Registers the given
DataStream as table in the
TableEnvironment 's catalog. |
<T> void |
StreamTableEnvironment.registerDataStream(String name,
DataStream<T> dataStream,
String fields)
Registers the given
DataStream as table with specified field names in the
TableEnvironment 's catalog. |
Modifier and Type | Method and Description |
---|---|
protected DataStream<Object> |
StreamScan.convertToExpectedType(DataStream<Object> input,
FlinkTable<?> flinkTable,
scala.Option<TypeInformation<Object>> expectedType,
TableConfig config) |
Modifier and Type | Method and Description |
---|---|
DataStream<T> |
DataStreamTable.dataStream() |
Constructor and Description |
---|
DataStreamTable(DataStream<T> dataStream,
int[] fieldIndexes,
String[] fieldNames) |
Modifier and Type | Method and Description |
---|---|
void |
CsvTableSink.emitDataStream(DataStream<Row> dataStream) |
void |
StreamTableSink.emitDataStream(DataStream<T> dataStream)
Emits the DataStream.
|
Modifier and Type | Method and Description |
---|---|
DataStream<T> |
StreamTableSource.getDataStream(StreamExecutionEnvironment execEnv)
Returns the data of the table as a
DataStream . |
DataStream<Row> |
CsvTableSource.getDataStream(StreamExecutionEnvironment streamExecEnv)
Returns the data of the table as a
DataStream of Row . |
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.