Modifier and Type | Class and Description |
---|---|
class |
RichMapFunction<IN,OUT>
Rich variant of the
MapFunction . |
Modifier and Type | Class and Description |
---|---|
class |
MapOperatorBase<IN,OUT,FT extends MapFunction<IN,OUT>> |
Modifier and Type | Method and Description |
---|---|
<R> MapOperator<T,R> |
DataSet.map(MapFunction<T,R> mapper)
Applies a Map transformation on this DataSet.
|
Modifier and Type | Class and Description |
---|---|
class |
FormattingMapper<T>
Mapper that converts values to strings using a
TextOutputFormat.TextFormatter . |
Modifier and Type | Field and Description |
---|---|
protected MapFunction<IN,OUT> |
MapOperator.function |
Modifier and Type | Method and Description |
---|---|
protected MapFunction<IN,OUT> |
MapOperator.getFunction() |
Modifier and Type | Method and Description |
---|---|
protected MapOperatorBase<IN,OUT,MapFunction<IN,OUT>> |
ProjectOperator.translateToDataFlow(Operator<IN> input) |
protected MapOperatorBase<IN,OUT,MapFunction<IN,OUT>> |
MapOperator.translateToDataFlow(Operator<IN> input) |
Constructor and Description |
---|
MapOperator(DataSet<IN> input,
TypeInformation<OUT> resultType,
MapFunction<IN,OUT> function,
String defaultName) |
Modifier and Type | Class and Description |
---|---|
class |
KeyExtractingMapper<T,K>
Mapper that extracts keys.
|
class |
KeyRemovingMapper<T,K>
Mapper that removes keys.
|
class |
TwoKeyExtractingMapper<T,K1,K2>
Mapper that extracts two keys of a value.
|
Modifier and Type | Method and Description |
---|---|
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getMapReturnTypes(MapFunction<IN,OUT> mapInterface,
TypeInformation<IN> inType) |
static <IN,OUT> TypeInformation<OUT> |
TypeExtractor.getMapReturnTypes(MapFunction<IN,OUT> mapInterface,
TypeInformation<IN> inType,
String functionName,
boolean allowMissing) |
Modifier and Type | Class and Description |
---|---|
static class |
KMeans.CentroidAverager
Computes new centroid from coordinate sum and count of points.
|
static class |
KMeans.CountAppender
Appends a count variable to the tuple.
|
static class |
KMeans.SelectNearestCenter
Determines the closest cluster center for a data point.
|
Modifier and Type | Class and Description |
---|---|
static class |
ConnectedComponents.DuplicateValue<T>
Function that turns a value into a 2-tuple where both fields are that value.
|
static class |
EnumTriangles.TupleEdgeConverter
Converts a Tuple2 into an Edge.
|
static class |
PageRank.Dampener
The function that applies the page rank dampening formula.
|
static class |
PageRank.RankAssigner
A map function that assigns an initial rank to all pages.
|
Modifier and Type | Class and Description |
---|---|
static class |
PiEstimation.Sampler
Sampler randomly emits points that fall within a square of edge x * y.
|
Modifier and Type | Class and Description |
---|---|
static class |
LinearRegression.SubUpdate
Compute a single BGD type update for every parameters.
|
static class |
LinearRegression.Update
Compute the final update by average them.
|
Modifier and Type | Field and Description |
---|---|
protected MapFunction<?,?> |
GraphCsvReader.mapper |
Modifier and Type | Method and Description |
---|---|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromCollection(Collection<Edge<K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a Collection of edges.
|
static <K,VV> GraphCsvReader |
Graph.fromCsvReader(String edgesPath,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a CSV file of edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromDataSet(DataSet<Edge<K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of edges.
|
static <K,VV> Graph<K,VV,NullValue> |
Graph.fromTuple2DataSet(DataSet<Tuple2<K,K>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple2 objects for edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromTupleDataSet(DataSet<Tuple3<K,K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple3 objects for edges.
|
<NV> Graph<K,VV,NV> |
Graph.mapEdges(MapFunction<Edge<K,EV>,NV> mapper)
Apply a function to the attribute of each edge in the graph.
|
<NV> Graph<K,VV,NV> |
Graph.mapEdges(MapFunction<Edge<K,EV>,NV> mapper,
TypeInformation<Edge<K,NV>> returnType)
Apply a function to the attribute of each edge in the graph.
|
<NV> Graph<K,NV,EV> |
Graph.mapVertices(MapFunction<Vertex<K,VV>,NV> mapper)
Apply a function to the attribute of each vertex in the graph.
|
<NV> Graph<K,NV,EV> |
Graph.mapVertices(MapFunction<Vertex<K,VV>,NV> mapper,
TypeInformation<Vertex<K,NV>> returnType)
Apply a function to the attribute of each vertex in the graph.
|
Constructor and Description |
---|
GraphCsvReader(Path edgePath,
MapFunction<K,VV> mapper,
ExecutionEnvironment context) |
GraphCsvReader(String edgePath,
MapFunction<K,VV> mapper,
ExecutionEnvironment context) |
Modifier and Type | Class and Description |
---|---|
static class |
DegreeAnnotationFunctions.MapEdgeToSourceId<K,EV>
Emits the source vertex ID along with an initial count.
|
static class |
DegreeAnnotationFunctions.MapEdgeToTargetId<K,EV>
Emits the target vertex ID along with an initial count.
|
Modifier and Type | Class and Description |
---|---|
class |
EdgeToTuple2Map<K,EV>
Create a Tuple2 DataSet from the vertices of an Edge DataSet.
|
class |
EdgeToTuple3Map<K,EV>
Create a Tuple3 DataSet from an Edge DataSet.
|
static class |
GraphUtils.IdentityMapper<T>
The identity mapper returns the input as output.
|
static class |
GraphUtils.MapTo<I,O>
Map each element to a value.
|
static class |
GraphUtils.NonForwardingIdentityMapper<T>
The identity mapper returns the input as output.
|
class |
Tuple2ToEdgeMap<K>
Create an Edge from a Tuple2.
|
class |
Tuple2ToVertexMap<K,VV>
Create a Vertex DataSet from a Tuple2 DataSet.
|
class |
Tuple3ToEdgeMap<K,EV>
Create an Edge DataSet from a Tuple3 DataSet.
|
class |
VertexToTuple2Map<K,VV>
Create a Tuple2 DataSet from a Vertex DataSet.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyDiscarder<T>
Utility function to extract the value from a Key-Value Tuple.
|
class |
NestedKeyDiscarder<IN>
Utility function to extract values from 2 Key-Value Tuples after a DefaultJoin.
|
class |
SerializerMap<IN>
Utility function to serialize values, usually directly from data sources.
|
class |
StringDeserializerMap
Utility function to deserialize strings, used for non-CSV sinks.
|
class |
StringTupleDeserializerMap
Utility function to deserialize strings, used for CSV sinks.
|
Modifier and Type | Method and Description |
---|---|
Class<MapFunction<IT,OT>> |
MapDriver.getStubType() |
Modifier and Type | Method and Description |
---|---|
void |
MapDriver.setup(TaskContext<MapFunction<IT,OT>,OT> context) |
Modifier and Type | Class and Description |
---|---|
class |
RemoveRangeIndex<T> |
Modifier and Type | Class and Description |
---|---|
static class |
StreamSQLTestProgram.KillMapper
Kills the first execution attempt of an application when it receives the second record.
|
Modifier and Type | Method and Description |
---|---|
<R> SingleOutputStreamOperator<R> |
DataStream.map(MapFunction<T,R> mapper)
Applies a Map transformation on a
DataStream . |
Constructor and Description |
---|
StreamMap(MapFunction<IN,OUT> mapper) |
Modifier and Type | Class and Description |
---|---|
static class |
IterateExample.InputMap
Map the inputs so that the next Fibonacci numbers can be calculated while preserving the original input tuple.
|
static class |
IterateExample.OutputMap
Giving back the input pair and the counter.
|
static class |
IterateExample.Step
Iteration step function that calculates the next Fibonacci number.
|
Modifier and Type | Class and Description |
---|---|
class |
RollingAdditionMapper
A
RichMapFunction that continuously outputs the current total frequency count of a key. |
Modifier and Type | Method and Description |
---|---|
PythonDataStream<SingleOutputStreamOperator<org.python.core.PyObject>> |
PythonDataStream.map(MapFunction<org.python.core.PyObject,org.python.core.PyObject> mapper)
A thin wrapper layer over
DataStream.map(MapFunction) . |
Modifier and Type | Class and Description |
---|---|
class |
PythonMapFunction
The
PythonMapFunction is a thin wrapper layer over a Python UDF MapFunction . |
Constructor and Description |
---|
PythonMapFunction(MapFunction<org.python.core.PyObject,org.python.core.PyObject> fun) |
Modifier and Type | Class and Description |
---|---|
class |
AdapterMap<IN>
A generic map operator that convert any java type to PyObject.
|
Modifier and Type | Class and Description |
---|---|
static class |
BucketingSinkTestProgram.SubtractingMapper
Subtracts the timestamp of the previous element from the current element.
|
class |
FailureMapper<T>
This mapper simulates failure by throwing exceptions.
|
Modifier and Type | Class and Description |
---|---|
class |
ArtificalOperatorStateMapper<IN,OUT>
A self-verifiable
RichMapFunction used to verify checkpointing and restore semantics for various
kinds of operator state. |
class |
ArtificialKeyedStateMapper<IN,OUT>
A generic, stateful
MapFunction that allows specifying what states to maintain
based on a provided list of ArtificialStateBuilder s. |
Constructor and Description |
---|
ArtificalOperatorStateMapper(MapFunction<IN,OUT> mapFunction) |
ArtificialKeyedStateMapper(MapFunction<IN,OUT> mapFunction,
ArtificialStateBuilder<IN> artificialStateBuilders) |
ArtificialKeyedStateMapper(MapFunction<IN,OUT> mapFunction,
List<ArtificialStateBuilder<IN>> artificialStateBuilders) |
Modifier and Type | Class and Description |
---|---|
static class |
StatefulStreamingJob.MyStatefulFunction
A stateful
RichMapFunction that keeps the required types of state. |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.