Modifier and Type | Interface and Description |
---|---|
interface |
CoGroupFunction<IN1,IN2,O>
The interface for CoGroup functions.
|
interface |
CombineFunction<IN,OUT>
Generic interface used for combine functions ("combiners").
|
interface |
CrossFunction<IN1,IN2,OUT>
Interface for Cross functions.
|
interface |
FilterFunction<T>
A filter function is a predicate applied individually to each record.
|
interface |
FlatJoinFunction<IN1,IN2,OUT>
Interface for Join functions.
|
interface |
FlatMapFunction<T,O>
Base interface for flatMap functions.
|
interface |
FoldFunction<O,T>
Base interface for Fold functions.
|
interface |
GroupCombineFunction<IN,OUT>
Generic interface used for combine functions ("combiners").
|
interface |
GroupReduceFunction<T,O>
The interface for group reduce functions.
|
interface |
JoinFunction<IN1,IN2,OUT>
Interface for Join functions.
|
interface |
MapFunction<T,O>
Base interface for Map functions.
|
interface |
MapPartitionFunction<T,O>
Interface for "mapPartition" functions.
|
interface |
ReduceFunction<T>
Base interface for Reduce functions.
|
interface |
RichFunction
An base interface for all rich user-defined functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractRichFunction
An abstract stub implementation for rich user-defined functions.
|
class |
RichCoGroupFunction<IN1,IN2,OUT>
Rich variant of the
CoGroupFunction . |
class |
RichCrossFunction<IN1,IN2,OUT>
Rich variant of the
CrossFunction . |
class |
RichFilterFunction<T>
Rich variant of the
FilterFunction . |
class |
RichFlatJoinFunction<IN1,IN2,OUT>
Rich variant of the
FlatJoinFunction . |
class |
RichFlatMapFunction<IN,OUT>
Rich variant of the
FlatMapFunction . |
class |
RichFoldFunction<O,T>
Rich variant of the
FoldFunction . |
class |
RichGroupCombineFunction<IN,OUT>
Rich variant of the
GroupCombineFunction . |
class |
RichGroupReduceFunction<IN,OUT>
Rich variant of the
GroupReduceFunction . |
class |
RichJoinFunction<IN1,IN2,OUT>
Rich variant of the
JoinFunction . |
class |
RichMapFunction<IN,OUT>
Rich variant of the
MapFunction . |
class |
RichMapPartitionFunction<I,O>
Rich variant of the
MapPartitionFunction . |
class |
RichReduceFunction<T>
Rich variant of the
ReduceFunction . |
Modifier and Type | Class and Description |
---|---|
class |
NoOpFunction |
Modifier and Type | Method and Description |
---|---|
static Method |
FunctionUtils.checkAndExtractLambdaMethod(Function function) |
static void |
FunctionUtils.closeFunction(Function function) |
static RuntimeContext |
FunctionUtils.getFunctionRuntimeContext(Function function,
RuntimeContext defaultContext) |
static void |
FunctionUtils.openFunction(Function function,
Configuration parameters) |
static void |
FunctionUtils.setFunctionRuntimeContext(Function function,
RuntimeContext context) |
Modifier and Type | Class and Description |
---|---|
class |
AbstractUdfOperator<OUT,FT extends Function>
Abstract superclass for all contracts that represent actual operators.
|
class |
DualInputOperator<IN1,IN2,OUT,FT extends Function>
Abstract operator superclass for for all operators that have two inputs, like "Join", "CoGroup", or "Cross".
|
class |
SingleInputOperator<IN,OUT,FT extends Function>
Abstract superclass for for all operators that have one input like "map" or "reduce".
|
Modifier and Type | Class and Description |
---|---|
static class |
BulkIterationBase.TerminationCriterionMapper<X>
Special Mapper that is added before a termination criterion and is only a container for an special aggregator
|
Modifier and Type | Interface and Description |
---|---|
interface |
KeySelector<IN,KEY>
The
KeySelector allows to use arbitrary objects for operations such as
reduce, reduceGroup, join, coGoup, etc. |
Modifier and Type | Class and Description |
---|---|
class |
FirstReducer<T> |
class |
FlatMapIterator<IN,OUT>
A convenience variant of the
RichFlatMapFunction that returns elements through an iterator, rather then
through a collector. |
class |
FormattingMapper<T> |
class |
GroupReduceIterator<IN,OUT> |
class |
SampleInCoordinator<T>
SampleInCoordinator wraps the sample logic of the coordinator side (the second phase of
distributed sample algorithm).
|
class |
SampleInPartition<T>
SampleInPartition wraps the sample logic on the partition side (the first phase of distributed
sample algorithm).
|
class |
SampleWithFraction<T>
A map partition function wrapper for sampling algorithms with fraction, the sample algorithm
takes the partition iterator as input.
|
class |
SelectByMaxFunction<T extends Tuple> |
class |
SelectByMinFunction<T extends Tuple> |
Modifier and Type | Class and Description |
---|---|
static class |
AggregateOperator.AggregatingUdf<T extends Tuple> |
static class |
CrossOperator.DefaultCrossFunction<T1,T2> |
static class |
CrossOperator.ProjectCrossFunction<T1,T2,R extends Tuple> |
static class |
DistinctOperator.DistinctFunction<T> |
static class |
JoinOperator.DefaultFlatJoinFunction<T1,T2> |
static class |
JoinOperator.DefaultJoin.WrappingFlatJoinFunction<IN1,IN2,OUT> |
static class |
JoinOperator.ProjectFlatJoinFunction<T1,T2,R extends Tuple> |
Modifier and Type | Method and Description |
---|---|
protected abstract Function |
TwoInputUdfOperator.getFunction() |
protected abstract Function |
SingleInputUdfOperator.getFunction() |
protected Function |
CoGroupRawOperator.getFunction() |
Modifier and Type | Method and Description |
---|---|
static void |
UdfOperatorUtils.analyzeDualInputUdf(TwoInputUdfOperator<?,?,?,?> operator,
Class<?> udfBaseClass,
String defaultName,
Function udf,
Keys<?> key1,
Keys<?> key2) |
static void |
UdfOperatorUtils.analyzeSingleInputUdf(SingleInputUdfOperator<?,?,?> operator,
Class<?> udfBaseClass,
String defaultName,
Function udf,
Keys<?> key) |
Modifier and Type | Class and Description |
---|---|
class |
WrappingFunction<T extends Function> |
Modifier and Type | Field and Description |
---|---|
protected T |
WrappingFunction.wrappedFunction |
Modifier and Type | Method and Description |
---|---|
static <IN1,IN2,OUT> |
TypeExtractor.getBinaryOperatorReturnType(Function function,
Class<?> baseClass,
boolean hasIterables,
boolean hasCollector,
TypeInformation<IN1> in1Type,
TypeInformation<IN2> in2Type,
String functionName,
boolean allowMissing)
Returns the binary operator's return type.
|
static <IN1,IN2,OUT> |
TypeExtractor.getBinaryOperatorReturnType(Function function,
Class<?> baseClass,
int inputTypeArgumentIndex,
int outputTypeArgumentIndex,
TypeInformation<IN1> in1Type,
TypeInformation<IN2> in2Type,
String functionName,
boolean allowMissing)
Returns the binary operator's return type.
|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getUnaryOperatorReturnType(Function function,
Class<?> baseClass,
boolean hasIterable,
boolean hasCollector,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing)
Returns the unary operator's return type.
|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getUnaryOperatorReturnType(Function function,
Class<?> baseClass,
int inputTypeArgumentIndex,
int outputTypeArgumentIndex,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing)
Returns the unary operator's return type.
|
Modifier and Type | Class and Description |
---|---|
static class |
ScalaAggregateOperator.AggregatingUdf<T extends scala.Product> |
Modifier and Type | Method and Description |
---|---|
<T extends Function> |
CodeGenerator.generateFunction(String name,
Class<T> clazz,
String bodyCode,
TypeInformation<Object> returnType)
Generates a
Function that can be passed to Java
compiler. |
Modifier and Type | Interface and Description |
---|---|
interface |
FunctionCompiler<T extends Function> |
Modifier and Type | Class and Description |
---|---|
class |
FlatJoinRunner<IN1,IN2,OUT> |
class |
FlatMapRunner<IN,OUT> |
class |
IntersectCoGroupFunction<T> |
class |
MapRunner<IN,OUT> |
class |
MinusCoGroupFunction<T> |
Modifier and Type | Class and Description |
---|---|
class |
AggregateMapFunction<IN,OUT> |
class |
AggregateReduceCombineFunction
It wraps the aggregate logic inside of
GroupReduceOperator and
GroupCombineOperator |
class |
AggregateReduceGroupFunction
It wraps the aggregate logic inside of
GroupReduceOperator . |
Modifier and Type | Class and Description |
---|---|
class |
CsvFormatter
Formats a
Row into a String with fields separated by the field delimiter. |
Modifier and Type | Interface and Description |
---|---|
interface |
PatternFlatSelectFunction<IN,OUT>
Base interface for a pattern select function which can produce multiple resulting elements.
|
interface |
PatternFlatTimeoutFunction<IN,OUT>
Base interface for a pattern timeout function which can produce multiple resulting elements.
|
interface |
PatternSelectFunction<IN,OUT>
Base interface for a pattern select function.
|
interface |
PatternTimeoutFunction<IN,OUT>
Base interface for a pattern timeout function.
|
Modifier and Type | Class and Description |
---|---|
class |
AndFilterFunction<T>
A filter function which combines two filter functions with a logical and.
|
class |
SubtypeFilterFunction<T>
A filter function which filters elements of the given type.
|
Modifier and Type | Class and Description |
---|---|
static class |
KMeans.CentroidAccumulator
Sums and counts point coordinates.
|
static class |
KMeans.CentroidAverager
Computes new centroid from coordinate sum and count of points.
|
static class |
KMeans.CountAppender
Appends a count variable to the tuple.
|
static class |
KMeans.SelectNearestCenter
Determines the closest cluster center for a data point.
|
Modifier and Type | Class and Description |
---|---|
static class |
ConnectedComponents.ComponentIdFilter |
static class |
ConnectedComponents.DuplicateValue<T>
Function that turns a value into a 2-tuple where both fields are that value.
|
static class |
ConnectedComponents.NeighborWithComponentIDJoin
UDF that joins a (Vertex-ID, Component-ID) pair that represents the current component that
a vertex is associated with, with a (Source-Vertex-ID, Target-VertexID) edge.
|
static class |
ConnectedComponents.UndirectEdge
Undirected edges by emitting for each input edge the input edges itself and an inverted version.
|
static class |
EnumTriangles.TupleEdgeConverter
Converts a Tuple2 into an Edge
|
static class |
PageRank.BuildOutgoingEdgeList
A reduce function that takes a sequence of edges and builds the adjacency list for the vertex where the edges
originate.
|
static class |
PageRank.Dampener
The function that applies the page rank dampening formula
|
static class |
PageRank.EpsilonFilter
Filter that filters vertices where the rank difference is below a threshold.
|
static class |
PageRank.JoinVertexWithEdgesMatch
Join function that distributes a fraction of a vertex's rank to all neighbors.
|
static class |
PageRank.RankAssigner
A map function that assigns an initial rank to all pages.
|
Modifier and Type | Class and Description |
---|---|
static class |
PiEstimation.Sampler
Sampler randomly emits points that fall within a square of edge x * y.
|
static class |
PiEstimation.SumReducer
Simply sums up all long values.
|
Modifier and Type | Class and Description |
---|---|
static class |
LinearRegression.SubUpdate
Compute a single BGD type update for every parameters.
|
static class |
LinearRegression.Update
Compute the final update by average them.
|
static class |
LinearRegression.UpdateAccumulator
Accumulator all the update.
|
Modifier and Type | Class and Description |
---|---|
static class |
EmptyFieldsCountAccumulator.EmptyFieldFilter
This function filters all incoming tuples that have one or more empty fields.
|
static class |
WebLogAnalysis.AntiJoinVisits
CoGroupFunction that realizes an anti-join.
|
static class |
WebLogAnalysis.FilterByRank
MapFunction that filters for records where the rank exceeds a certain threshold.
|
static class |
WebLogAnalysis.FilterDocByKeyWords
MapFunction that filters for documents that contain a certain set of
keywords.
|
static class |
WebLogAnalysis.FilterVisitsByDate
MapFunction that filters for records of the visits relation where the year
(from the date string) is equal to a certain value.
|
Modifier and Type | Class and Description |
---|---|
static class |
WordCount.Tokenizer
Implements the string tokenizer that splits sentences into words as a user-defined
FlatMapFunction.
|
static class |
WordCountPojo.Tokenizer
Implements the string tokenizer that splits sentences into words as a user-defined
FlatMapFunction.
|
Modifier and Type | Class and Description |
---|---|
static class |
EnumTriangles.TriadBuilder
Builds triads (triples of vertices) from pairs of edges that share a vertex.
|
Modifier and Type | Interface and Description |
---|---|
interface |
EdgeJoinFunction<EV,T>
Interface to be implemented by the transformation function
applied in
Graph.joinWithEdges(DataSet, EdgeJoinFunction) ,
Graph.joinWithEdgesOnSource(DataSet, EdgeJoinFunction) , and
Graph.joinWithEdgesOnTarget(DataSet, EdgeJoinFunction) methods. |
interface |
EdgesFunction<K,EV,O>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.groupReduceOnEdges(EdgesFunction, EdgeDirection) method. |
interface |
EdgesFunctionWithVertexValue<K,VV,EV,O>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.groupReduceOnEdges(EdgesFunctionWithVertexValue, EdgeDirection)
method. |
interface |
NeighborsFunction<K,VV,EV,O>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.groupReduceOnNeighbors(NeighborsFunction, EdgeDirection)
method. |
interface |
NeighborsFunctionWithVertexValue<K,VV,EV,O>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.groupReduceOnNeighbors(NeighborsFunctionWithVertexValue, EdgeDirection)
method. |
interface |
ReduceEdgesFunction<EV>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.reduceOnEdges(org.apache.flink.graph.ReduceEdgesFunction, EdgeDirection) method. |
interface |
ReduceNeighborsFunction<VV>
Interface to be implemented by the function applied to a vertex neighborhood
in the
Graph.reduceOnNeighbors(ReduceNeighborsFunction, EdgeDirection)
method. |
interface |
VertexJoinFunction<VV,T>
Interface to be implemented by the transformation function
applied in
Graph.joinWithVertices(DataSet, VertexJoinFunction) method. |
Modifier and Type | Class and Description |
---|---|
static class |
DegreeAnnotationFunctions.DegreeCount<K>
Combines the vertex degree count.
|
static class |
DegreeAnnotationFunctions.JoinEdgeDegreeWithVertexDegree<K,EV,D>
Composes the vertex degree with this edge value.
|
static class |
DegreeAnnotationFunctions.JoinEdgeWithVertexDegree<K,EV,D>
Assigns the vertex degree to this edge value.
|
static class |
DegreeAnnotationFunctions.JoinVertexWithVertexDegree<K,VV>
Performs a left outer join to apply a zero count for vertices with
out- or in-degree of zero.
|
static class |
DegreeAnnotationFunctions.MapEdgeToSourceId<K,EV>
Emits the source vertex ID along with an initial count.
|
static class |
DegreeAnnotationFunctions.MapEdgeToTargetId<K,EV>
Emits the target vertex ID along with an initial count.
|
Modifier and Type | Interface and Description |
---|---|
interface |
TranslateFunction<T,O>
Base interface for Translate functions.
|
Modifier and Type | Class and Description |
---|---|
class |
LongValueAddOffset
Translate
LongValue by adding a constant offset value. |
class |
LongValueToIntValue
|
class |
LongValueToStringValue
Translate
LongValue to StringValue . |
class |
RichTranslateFunction<IN,OUT>
Rich variant of the
TranslateFunction . |
Modifier and Type | Class and Description |
---|---|
static class |
MusicProfiles.CreateSimilarUserEdges |
static class |
MusicProfiles.ExtractMismatchSongIds |
static class |
MusicProfiles.FilterOutMismatches |
static class |
MusicProfiles.FilterSongNodes |
static class |
MusicProfiles.GetTopSongPerUser |
Modifier and Type | Class and Description |
---|---|
class |
CompleteGraph.LinkVertexToAll |
class |
GridGraph.LinkVertexToNeighbors |
class |
StarGraph.LinkVertexToCenter |
Modifier and Type | Class and Description |
---|---|
static class |
CommunityDetection.AddScoreToVertexValuesMapper<K> |
static class |
CommunityDetection.RemoveScoreFromVertexValuesMapper<K> |
static class |
GSASingleSourceShortestPaths.InitVerticesMapper<K> |
static class |
SingleSourceShortestPaths.InitVerticesMapper<K> |
Modifier and Type | Class and Description |
---|---|
static class |
VertexCentricIteration.MessageCombinerUdf<K,Message> |
Modifier and Type | Class and Description |
---|---|
class |
EdgesFunction<K,EV,T> |
class |
EdgesFunctionWithVertexValue<K,VV,EV,T> |
class |
NeighborsFunction<K,VV,EV,T> |
class |
NeighborsFunctionWithVertexValue<K,VV,EV,T> |
Modifier and Type | Class and Description |
---|---|
class |
EdgeToTuple3Map<K,EV>
Create a Tuple3 DataSet from an Edge DataSet
|
static class |
GraphUtils.AddLongValue
Add
LongValue elements. |
static class |
GraphUtils.MapTo<I,O>
Map each element to a value.
|
class |
NullValueEdgeMapper<K,EV> |
class |
Tuple2ToVertexMap<K,VV>
Create a Vertex DataSet from a Tuple2 DataSet
|
class |
Tuple3ToEdgeMap<K,EV>
Create an Edge DataSet from a Tuple3 DataSet
|
class |
VertexToTuple2Map<K,VV>
Create a Tuple2 DataSet from a Vertex DataSet
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopMapFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
This wrapper maps a Hadoop Mapper (mapred API) to a Flink FlatMapFunction.
|
class |
HadoopReduceCombineFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
This wrapper maps a Hadoop Reducer and Combiner (mapred API) to a combinable Flink GroupReduceFunction.
|
class |
HadoopReduceFunction<KEYIN,VALUEIN,KEYOUT,VALUEOUT>
This wrapper maps a Hadoop Reducer (mapred API) to a non-combinable Flink GroupReduceFunction.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonCoGroup<IN1,IN2,OUT>
CoGroupFunction that uses a python script.
|
class |
PythonMapPartition<IN,OUT>
Multi-purpose class, usable by all operations using a python script with one input source and possibly differing
in-/output types.
|
Modifier and Type | Class and Description |
---|---|
class |
IdentityGroupReduce<IN> |
class |
KeyDiscarder<T> |
class |
NestedKeyDiscarder<IN> |
class |
SerializerMap<IN> |
class |
StringDeserializerMap |
class |
StringTupleDeserializerMap |
Modifier and Type | Class and Description |
---|---|
class |
AbstractIterativeTask<S extends Function,OT>
The abstract base class for all tasks able to participate in an iteration.
|
class |
IterationHeadTask<X,Y,S extends Function,OT>
The head is responsible for coordinating an iteration and can run a
Driver inside. |
class |
IterationIntermediateTask<S extends Function,OT>
An intermediate iteration task, which runs a
Driver inside. |
class |
IterationTailTask<S extends Function,OT>
An iteration tail, which runs a driver inside.
|
Modifier and Type | Class and Description |
---|---|
class |
BatchTask<S extends Function,OT>
The base class for all batch tasks.
|
interface |
Driver<S extends Function,OT>
The interface to be implemented by all drivers that run alone (or as the primary driver) in a task.
|
interface |
ResettableDriver<S extends Function,OT>
This interface marks a
Driver as resettable, meaning that will reset part of their internal state but
otherwise reuse existing data structures. |
Modifier and Type | Field and Description |
---|---|
protected S |
BatchTask.stub
The instantiated user code of this task's main operator (driver).
|
Modifier and Type | Method and Description |
---|---|
Function |
NoOpChainedDriver.getStub() |
Modifier and Type | Method and Description |
---|---|
Class<Function> |
UnionWithTempOperator.getStubType() |
Modifier and Type | Method and Description |
---|---|
static void |
BatchTask.closeUserCode(Function stub)
Closes the given stub using its
RichFunction.close() method. |
static void |
BatchTask.openUserCode(Function stub,
Configuration parameters)
Opens the given stub using its
RichFunction.open(Configuration) method. |
Modifier and Type | Method and Description |
---|---|
void |
UnionWithTempOperator.setup(TaskContext<Function,T> context) |
Modifier and Type | Method and Description |
---|---|
Function |
SynchronousChainedCombineDriver.getStub() |
Function |
GroupCombineChainedDriver.getStub() |
Function |
ChainedReduceCombineDriver.getStub() |
Function |
ChainedMapDriver.getStub() |
Function |
ChainedFlatMapDriver.getStub() |
abstract Function |
ChainedDriver.getStub() |
Function |
ChainedAllReduceDriver.getStub() |
Modifier and Type | Class and Description |
---|---|
class |
AssignRangeIndex<IN>
This mapPartition function require a DataSet with RangeBoundaries as broadcast input, it
generate Tuple2 which includes range index and record itself as output.
|
class |
RangeBoundaryBuilder<T>
Build RangeBoundaries with input records.
|
class |
RemoveRangeIndex<T> |
Modifier and Type | Method and Description |
---|---|
<S extends Function,OT> |
TaskConfig.getDriver() |
Modifier and Type | Class and Description |
---|---|
static class |
SpoutSplitExample.Enrich
Same as
VerifyAndEnrichBolt . |
Modifier and Type | Class and Description |
---|---|
class |
SplitStreamMapper<T>
|
Modifier and Type | Class and Description |
---|---|
static class |
SpoutSourceWordCount.Tokenizer
Implements the string tokenizer that splits sentences into words as a user-defined FlatMapFunction.
|
Modifier and Type | Class and Description |
---|---|
class |
SpoutWrapper<OUT>
A
SpoutWrapper wraps an IRichSpout in order to execute it within a Flink Streaming program. |
Modifier and Type | Interface and Description |
---|---|
interface |
AssignerWithPeriodicWatermarks<T>
The
AssignerWithPeriodicWatermarks assigns event time timestamps to elements,
and generates low watermarks that signal event time progress within the stream. |
interface |
AssignerWithPunctuatedWatermarks<T>
The
AssignerWithPunctuatedWatermarks assigns event time timestamps to elements,
and generates low watermarks that signal event time progress within the stream. |
interface |
TimestampAssigner<T>
A
TimestampAssigner assigns event time timestamps to elements. |
interface |
TimestampExtractor<T>
Deprecated.
This class has been replaced by
AssignerWithPeriodicWatermarks and
AssignerWithPunctuatedWatermarks |
Modifier and Type | Class and Description |
---|---|
class |
IngestionTimeExtractor<T>
A timestamp assigner that assigns timestamps based on the machine's wall clock.
|
Modifier and Type | Class and Description |
---|---|
class |
AggregationFunction<T> |
class |
ComparableAggregator<T> |
class |
SumAggregator<T> |
Modifier and Type | Interface and Description |
---|---|
interface |
CoFlatMapFunction<IN1,IN2,OUT>
A CoFlatMapFunction implements a flat-map transformation over two
connected streams.
|
interface |
CoMapFunction<IN1,IN2,OUT>
A CoFlatMapFunction implements a map() transformation over two
connected streams.
|
Modifier and Type | Class and Description |
---|---|
class |
RichCoFlatMapFunction<IN1,IN2,OUT>
A RichCoFlatMapFunction represents a FlatMap transformation with two different input
types.
|
class |
RichCoMapFunction<IN1,IN2,OUT>
A RichCoMapFunction represents a Map transformation with two different input
types.
|
Modifier and Type | Interface and Description |
---|---|
interface |
SinkFunction<IN>
Interface for implementing user defined sink functionality.
|
Modifier and Type | Class and Description |
---|---|
class |
DiscardingSink<T>
A stream sink that ignores all elements.
|
class |
OutputFormatSinkFunction<IN>
Simple implementation of the SinkFunction writing tuples in the specified
OutputFormat format.
|
class |
PrintSinkFunction<IN>
Implementation of the SinkFunction writing every tuple to the standard
output or standard error stream.
|
class |
RichSinkFunction<IN> |
class |
SocketClientSink<IN>
Socket client that acts as a streaming sink.
|
class |
WriteSinkFunction<IN>
Simple implementation of the SinkFunction writing tuples as simple text to
the file specified by path.
|
class |
WriteSinkFunctionByMillis<IN>
Implementation of WriteSinkFunction.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ParallelSourceFunction<OUT>
A stream data source that is executed in parallel.
|
interface |
SourceFunction<T>
Base interface for all stream data sources in Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
ConnectorSource<OUT> |
class |
ContinuousFileMonitoringFunction<OUT>
This is the single (non-parallel) task which takes a
FileInputFormat and is responsible for
i) monitoring a user-provided path, ii) deciding which files should be further read and processed,
iii) creating the FileInputSplits corresponding to those files, and iv) assigning
them to downstream tasks for further reading and processing. |
class |
FileMonitoringFunction
Deprecated.
|
class |
FileReadFunction
Deprecated.
|
class |
FromElementsFunction<T>
A stream source function that returns a sequence of elements.
|
class |
FromIteratorFunction<T> |
class |
FromSplittableIteratorFunction<T> |
class |
InputFormatSourceFunction<OUT> |
class |
MessageAcknowledgingSourceBase<Type,UId>
Abstract base class for data sources that receive elements from a message queue and
acknowledge them back by IDs.
|
class |
MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>
Abstract base class for data sources that receive elements from a message queue and
acknowledge them back by IDs.
|
class |
RichParallelSourceFunction<OUT>
Base class for implementing a parallel data source.
|
class |
RichSourceFunction<OUT>
Base class for implementing a parallel data source that has access to context information
(via
AbstractRichFunction.getRuntimeContext() ) and additional life-cycle methods
(AbstractRichFunction.open(org.apache.flink.configuration.Configuration) and AbstractRichFunction.close() . |
class |
SocketTextStreamFunction
A source function that reads strings from a socket.
|
class |
StatefulSequenceSource
A stateful streaming source that emits each number from a given interval exactly once,
possibly in parallel.
|
Modifier and Type | Class and Description |
---|---|
class |
AscendingTimestampExtractor<T>
A timestamp assigner and watermark generator for streams where timestamps are monotonously
ascending.
|
class |
BoundedOutOfOrdernessTimestampExtractor<T>
This is a
AssignerWithPeriodicWatermarks used to emit Watermarks that lag behind the element with
the maximum timestamp (in event time) seen so far by a fixed amount of time, t_late . |
Modifier and Type | Interface and Description |
---|---|
interface |
AllWindowFunction<IN,OUT,W extends Window>
Base interface for functions that are evaluated over non-keyed windows.
|
interface |
WindowFunction<IN,OUT,KEY,W extends Window>
Base interface for functions that are evaluated over keyed (grouped) windows.
|
Modifier and Type | Class and Description |
---|---|
class |
FoldApplyAllWindowFunction<W extends Window,T,ACC> |
class |
FoldApplyWindowFunction<K,W extends Window,T,ACC> |
class |
PassThroughAllWindowFunction<W extends Window,T> |
class |
PassThroughWindowFunction<K,W extends Window,T> |
class |
ReduceApplyAllWindowFunction<W extends Window,T,R> |
class |
ReduceApplyWindowFunction<K,W extends Window,T,R> |
class |
ReduceIterableAllWindowFunction<W extends Window,T> |
class |
ReduceIterableWindowFunction<K,W extends Window,T> |
class |
RichAllWindowFunction<IN,OUT,W extends Window> |
class |
RichWindowFunction<IN,OUT,KEY,W extends Window>
Rich variant of the
WindowFunction . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractUdfStreamOperator<OUT,F extends Function>
This is used as the base class for operators that have a user-defined
function.
|
Modifier and Type | Field and Description |
---|---|
protected F |
AbstractUdfStreamOperator.userFunction
the user function
|
Modifier and Type | Class and Description |
---|---|
class |
KeySelectorWithType<IN,K> |
Modifier and Type | Interface and Description |
---|---|
interface |
StatefulFunction<I,O,S>
Trait implementing the functionality necessary to apply stateful functions in
RichFunctions without exposing the OperatorStates to the user.
|
Modifier and Type | Class and Description |
---|---|
class |
ScalaAllWindowFunction<IN,OUT,W extends Window>
A wrapper function that exposes a Scala Function3 as a Java AllWindowFunction.
|
class |
ScalaAllWindowFunctionWrapper<IN,OUT,W extends Window>
A wrapper function that exposes a Scala WindowFunction as a JavaWindow function.
|
class |
ScalaFoldFunction<T,R>
A wrapper function that exposes a Scala Function2 as a
FoldFunction . |
class |
ScalaReduceFunction<T>
A wrapper function that exposes a Scala Function2 as a
ReduceFunction . |
class |
ScalaWindowFunction<IN,OUT,KEY,W extends Window>
A wrapper function that exposes a Scala Function4 as a Java WindowFunction.
|
class |
ScalaWindowFunctionWrapper<IN,OUT,KEY,W extends Window>
A wrapper function that exposes a Scala WindowFunction as a JavaWindow function.
|
Modifier and Type | Class and Description |
---|---|
class |
CassandraPojoSink<IN>
Flink Sink to save data into a Cassandra cluster using
Mapper , which
it uses annotations from com.datastax.driver.mapping . |
class |
CassandraSinkBase<IN,V>
CassandraSinkBase is the common abstract class of
CassandraPojoSink and CassandraTupleSink . |
class |
CassandraTupleSink<IN extends Tuple>
Flink Sink to save data into a Cassandra cluster.
|
Modifier and Type | Interface and Description |
---|---|
interface |
IndexRequestBuilder<T>
Function that creates an
IndexRequest from an element in a Stream. |
Modifier and Type | Class and Description |
---|---|
class |
ElasticsearchSink<T>
Sink that emits its input elements to an Elasticsearch cluster.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ElasticsearchSinkFunction<T>
Method that creates an
ActionRequest from an element in a Stream. |
Modifier and Type | Class and Description |
---|---|
class |
FlumeSink<IN> |
Modifier and Type | Class and Description |
---|---|
class |
RollingSink<T>
Sink that emits its input elements to rolling
FileSystem files. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaConsumer08<T>
The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from
Apache Kafka 0.8.x.
|
class |
FlinkKafkaConsumer081<T>
Deprecated.
|
class |
FlinkKafkaConsumer082<T>
Deprecated.
|
class |
FlinkKafkaConsumer09<T>
The Flink Kafka Consumer is a streaming data source that pulls a parallel data stream from
Apache Kafka 0.9.x.
|
class |
FlinkKafkaConsumerBase<T>
Base class of all Flink Kafka Consumer data sources.
|
class |
FlinkKafkaProducer<IN>
Deprecated.
|
class |
FlinkKafkaProducer08<IN>
Flink Sink to produce data into a Kafka topic.
|
class |
FlinkKafkaProducer09<IN>
Flink Sink to produce data into a Kafka topic.
|
class |
FlinkKafkaProducerBase<IN>
Flink Sink to produce data into a Kafka topic.
|
Modifier and Type | Interface and Description |
---|---|
interface |
NiFiDataPacketBuilder<T>
A function that can create a NiFiDataPacket from an incoming instance of the given type.
|
Modifier and Type | Class and Description |
---|---|
class |
NiFiSink<T>
A sink that delivers data to Apache NiFi using the NiFi Site-to-Site client.
|
class |
NiFiSource
A source that pulls data from Apache NiFi using the NiFi Site-to-Site client.
|
Modifier and Type | Class and Description |
---|---|
class |
RMQSink<IN>
A Sink for publishing data into RabbitMQ
|
class |
RMQSource<OUT>
RabbitMQ source (consumer) which reads from a queue and acknowledges messages on checkpoints.
|
Modifier and Type | Class and Description |
---|---|
class |
RedisSink<IN>
A sink that delivers data to a Redis channel using the Jedis client.
|
Modifier and Type | Interface and Description |
---|---|
interface |
RedisMapper<T>
Function that creates the description how the input data should be mapped to redis type.
|
Modifier and Type | Class and Description |
---|---|
class |
TwitterSource
Implementation of
SourceFunction specialized to emit tweets from
Twitter. |
Modifier and Type | Class and Description |
---|---|
class |
WikipediaEditsSource |
Modifier and Type | Class and Description |
---|---|
static class |
IterateExample.InputMap
Map the inputs so that the next Fibonacci numbers can be calculated while preserving the original input tuple A
counter is attached to the tuple and incremented in every iteration step
|
static class |
IterateExample.OutputMap
Giving back the input pair and the counter
|
static class |
IterateExample.Step
Iteration step function that calculates the next Fibonacci number
|
Modifier and Type | Class and Description |
---|---|
static class |
IncrementalLearningSkeleton.FiniteNewDataSource
Feeds new data for newData.
|
static class |
IncrementalLearningSkeleton.FiniteTrainingDataSource
Feeds new training data for the partial model builder.
|
static class |
IncrementalLearningSkeleton.LinearTimestamp |
static class |
IncrementalLearningSkeleton.PartialModelBuilder
Builds up-to-date partial models on new training data.
|
static class |
IncrementalLearningSkeleton.Predictor
Creates newData using the model produced in batch-processing and the
up-to-date partial model.
|
Modifier and Type | Class and Description |
---|---|
static class |
TwitterExample.SelectEnglishAndTokenizeFlatMap
Deserialize JSON from twitter source
|
Modifier and Type | Class and Description |
---|---|
static class |
GroupedProcessingTimeWindowExample.FirstFieldKeyExtractor<Type extends Tuple,Key> |
static class |
GroupedProcessingTimeWindowExample.SummingReducer |
static class |
GroupedProcessingTimeWindowExample.SummingWindowFunction |
Modifier and Type | Class and Description |
---|---|
static class |
PojoExample.Tokenizer
Implements the string tokenizer that splits sentences into words as a
user-defined FlatMapFunction.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractAlignedProcessingTimeWindowOperator<KEY,IN,OUT,STATE,F extends Function> |
Modifier and Type | Method and Description |
---|---|
protected AggregatingKeyedTimePanes<IN,KEY> |
AggregatingProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function) |
protected AccumulatingKeyedTimePanes<IN,KEY,OUT> |
AccumulatingProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function) |
protected abstract AbstractKeyedTimePanes<IN,KEY,STATE,OUT> |
AbstractAlignedProcessingTimeWindowOperator.createPanes(KeySelector<IN,KEY> keySelector,
Function function) |
Modifier and Type | Class and Description |
---|---|
class |
InternalIterableAllWindowFunction<IN,OUT,W extends Window>
Internal window function for wrapping an
AllWindowFunction that takes an Iterable
when the window state also is an Iterable . |
class |
InternalIterableWindowFunction<IN,OUT,KEY,W extends Window>
Internal window function for wrapping a
WindowFunction that takes an Iterable
when the window state also is an Iterable . |
class |
InternalSingleValueAllWindowFunction<IN,OUT,W extends Window>
Internal window function for wrapping an
AllWindowFunction that takes an Iterable
when the window state is a single value. |
class |
InternalSingleValueWindowFunction<IN,OUT,KEY,W extends Window>
Internal window function for wrapping a
WindowFunction that takes an Iterable
when the window state is a single value. |
class |
InternalWindowFunction<IN,OUT,KEY,W extends Window>
Internal interface for functions that are evaluated over keyed (grouped) windows.
|
Modifier and Type | Class and Description |
---|---|
static class |
KeySelectorUtil.ArrayKeySelector<IN>
A key selector for selecting individual array fields as keys and returns them as a Tuple.
|
static class |
KeySelectorUtil.ComparableKeySelector<IN>
A key selector for selecting key fields via a TypeComparator.
|
static class |
KeySelectorUtil.OneKeySelector<IN,K>
Key extractor that extracts a single field via a generic comparator.
|
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.