Modifier and Type | Class and Description |
---|---|
class |
CollectionEnvironment
Version of
ExecutionEnvironment that allows serial, local, collection-based executions of
Flink programs. |
class |
LocalEnvironment
An
ExecutionEnvironment that runs the program locally, multi-threaded, in the JVM where
the environment is instantiated. |
class |
RemoteEnvironment
An
ExecutionEnvironment that sends programs to a cluster for execution. |
class |
ScalaShellEnvironment
Special version of
ExecutionEnvironment that has a reference to
a FlinkILoop . |
Modifier and Type | Field and Description |
---|---|
protected ExecutionEnvironment |
DataSet.context |
Modifier and Type | Method and Description |
---|---|
ExecutionEnvironment |
ExecutionEnvironmentFactory.createExecutionEnvironment()
Creates an ExecutionEnvironment from this factory.
|
static ExecutionEnvironment |
ExecutionEnvironment.createLocalEnvironmentWithWebUI(Configuration conf)
Creates a
LocalEnvironment for local program execution that also starts the web
monitoring UI. |
static ExecutionEnvironment |
ExecutionEnvironment.createRemoteEnvironment(String host,
int port,
Configuration clientConfiguration,
String... jarFiles)
Creates a
RemoteEnvironment . |
static ExecutionEnvironment |
ExecutionEnvironment.createRemoteEnvironment(String host,
int port,
int parallelism,
String... jarFiles)
Creates a
RemoteEnvironment . |
static ExecutionEnvironment |
ExecutionEnvironment.createRemoteEnvironment(String host,
int port,
String... jarFiles)
Creates a
RemoteEnvironment . |
ExecutionEnvironment |
DataSet.getExecutionEnvironment()
Returns the
ExecutionEnvironment in which this DataSet is registered. |
static ExecutionEnvironment |
ExecutionEnvironment.getExecutionEnvironment()
Creates an execution environment that represents the context in which the program is
currently executed.
|
Constructor and Description |
---|
DataSet(ExecutionEnvironment context,
TypeInformation<T> typeInfo) |
Constructor and Description |
---|
CsvReader(Path filePath,
ExecutionEnvironment executionContext) |
CsvReader(String filePath,
ExecutionEnvironment executionContext) |
Constructor and Description |
---|
DataSource(ExecutionEnvironment context,
InputFormat<OUT,?> inputFormat,
TypeInformation<OUT> type,
String dataSourceLocationName)
Creates a new data source.
|
DeltaIteration(ExecutionEnvironment context,
TypeInformation<ST> type,
DataSet<ST> solutionSet,
DataSet<WT> workset,
Keys<ST> keys,
int maxIterations) |
IterativeDataSet(ExecutionEnvironment context,
TypeInformation<T> type,
DataSet<T> input,
int maxIterations) |
Operator(ExecutionEnvironment context,
TypeInformation<OUT> resultType) |
Modifier and Type | Class and Description |
---|---|
class |
ContextEnvironment
Execution Environment for remote execution with the Client.
|
class |
OptimizerPlanEnvironment
An
ExecutionEnvironment that never executes a job but only extracts the Pipeline . |
Modifier and Type | Method and Description |
---|---|
DataSet<Row> |
AbstractHBaseTableSource.getDataSet(ExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
static DataSet<KMeans.Centroid> |
KMeansData.getDefaultCentroidDataSet(ExecutionEnvironment env) |
static DataSet<KMeans.Point> |
KMeansData.getDefaultPointDataSet(ExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
static DataSet<EnumTrianglesDataTypes.Edge> |
EnumTrianglesData.getDefaultEdgeDataSet(ExecutionEnvironment env) |
static DataSet<Tuple2<Long,Long>> |
PageRankData.getDefaultEdgeDataSet(ExecutionEnvironment env) |
static DataSet<Tuple2<Long,Long>> |
ConnectedComponentsData.getDefaultEdgeDataSet(ExecutionEnvironment env) |
static DataSet<Long> |
PageRankData.getDefaultPagesDataSet(ExecutionEnvironment env) |
static DataSet<Long> |
ConnectedComponentsData.getDefaultVertexDataSet(ExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
static DataSet<LinearRegression.Data> |
LinearRegressionData.getDefaultDataDataSet(ExecutionEnvironment env) |
static DataSet<LinearRegression.Params> |
LinearRegressionData.getDefaultParamsDataSet(ExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
static DataSet<Tuple2<String,String>> |
WebLogData.getDocumentDataSet(ExecutionEnvironment env) |
static DataSet<Tuple3<Integer,String,Integer>> |
WebLogData.getRankDataSet(ExecutionEnvironment env) |
static DataSet<Tuple2<String,String>> |
WebLogData.getVisitDataSet(ExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
static DataSet<String> |
WordCountData.getDefaultTextLineDataSet(ExecutionEnvironment env) |
Modifier and Type | Method and Description |
---|---|
DataSet<Row> |
ParquetTableSource.getDataSet(ExecutionEnvironment executionEnvironment) |
Modifier and Type | Field and Description |
---|---|
protected ExecutionEnvironment |
GraphAnalyticBase.env |
Modifier and Type | Method and Description |
---|---|
ExecutionEnvironment |
Graph.getContext() |
ExecutionEnvironment |
Runner.getExecutionEnvironment()
Get the ExecutionEnvironment.
|
Modifier and Type | Method and Description |
---|---|
static <K,EV> Graph<K,NullValue,EV> |
Graph.fromCollection(Collection<Edge<K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a Collection of edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromCollection(Collection<Edge<K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a Collection of edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromCollection(Collection<Vertex<K,VV>> vertices,
Collection<Edge<K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a Collection of vertices and a Collection of edges.
|
static GraphCsvReader |
Graph.fromCsvReader(String edgesPath,
ExecutionEnvironment context)
Creates a graph from a CSV file of edges.
|
static <K,VV> GraphCsvReader |
Graph.fromCsvReader(String edgesPath,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a CSV file of edges.
|
static GraphCsvReader |
Graph.fromCsvReader(String verticesPath,
String edgesPath,
ExecutionEnvironment context)
Creates a Graph from a CSV file of vertices and a CSV file of edges.
|
static <K,EV> Graph<K,NullValue,EV> |
Graph.fromDataSet(DataSet<Edge<K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a DataSet of edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromDataSet(DataSet<Edge<K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromDataSet(DataSet<Vertex<K,VV>> vertices,
DataSet<Edge<K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a DataSet of vertices and a DataSet of edges.
|
static <K> Graph<K,NullValue,NullValue> |
Graph.fromTuple2DataSet(DataSet<Tuple2<K,K>> edges,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple2 objects for edges.
|
static <K,VV> Graph<K,VV,NullValue> |
Graph.fromTuple2DataSet(DataSet<Tuple2<K,K>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple2 objects for edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromTupleDataSet(DataSet<Tuple2<K,VV>> vertices,
DataSet<Tuple3<K,K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple2 objects for vertices and Tuple3 objects for edges.
|
static <K,EV> Graph<K,NullValue,EV> |
Graph.fromTupleDataSet(DataSet<Tuple3<K,K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple3 objects for edges.
|
static <K,VV,EV> Graph<K,VV,EV> |
Graph.fromTupleDataSet(DataSet<Tuple3<K,K,EV>> edges,
MapFunction<K,VV> vertexValueInitializer,
ExecutionEnvironment context)
Creates a graph from a DataSet of Tuple3 objects for edges.
|
<A> A |
AnalyticHelper.getAccumulator(ExecutionEnvironment env,
String accumulatorName)
Gets the accumulator with the given name.
|
Constructor and Description |
---|
Graph(DataSet<Vertex<K,VV>> vertices,
DataSet<Edge<K,EV>> edges,
ExecutionEnvironment context)
Creates a graph from two DataSets: vertices and edges.
|
GraphCsvReader(Path edgePath,
ExecutionEnvironment context) |
GraphCsvReader(Path edgePath,
MapFunction<K,VV> mapper,
ExecutionEnvironment context) |
GraphCsvReader(Path vertexPath,
Path edgePath,
ExecutionEnvironment context) |
GraphCsvReader(String edgePath,
ExecutionEnvironment context) |
GraphCsvReader(String edgePath,
MapFunction<K,VV> mapper,
ExecutionEnvironment context) |
GraphCsvReader(String vertexPath,
String edgePath,
ExecutionEnvironment context) |
Modifier and Type | Field and Description |
---|---|
protected ExecutionEnvironment |
DataSetAnalyticBase.env |
Modifier and Type | Method and Description |
---|---|
static <KT,KB,VVT,VVB,EV> |
BipartiteGraph.fromDataSet(DataSet<Vertex<KT,VVT>> topVertices,
DataSet<Vertex<KB,VVB>> bottomVertices,
DataSet<BipartiteEdge<KT,KB,EV>> edges,
ExecutionEnvironment context)
Create bipartite graph from datasets.
|
Modifier and Type | Method and Description |
---|---|
static DataSet<Vertex<LongValue,NullValue>> |
GraphGeneratorUtils.vertexSequence(ExecutionEnvironment env,
int parallelism,
long vertexCount)
Generates
Vertices with sequential, numerical labels. |
Constructor and Description |
---|
CirculantGraph(ExecutionEnvironment env,
long vertexCount)
An oriented
Graph with n vertices where each vertex vi is
connected to vertex v(i+j)%n for each configured offset j . |
CompleteGraph(ExecutionEnvironment env,
long vertexCount)
An undirected
Graph connecting every distinct pair of vertices. |
CycleGraph(ExecutionEnvironment env,
long vertexCount)
An undirected
Graph with n vertices where each vertex vi is
connected to adjacent vertices v(i+1)%n and v(i-1)%n. |
EchoGraph(ExecutionEnvironment env,
long vertexCount,
long vertexDegree)
An undirected
Graph whose vertices have the same degree. |
EmptyGraph(ExecutionEnvironment env,
long vertexCount)
The
Graph containing no edges. |
GridGraph(ExecutionEnvironment env)
An undirected
Graph connecting vertices in a regular tiling in one or more dimensions
and where the endpoints are optionally connected. |
HypercubeGraph(ExecutionEnvironment env,
long dimensions)
An undirected
Graph where edges form an n-dimensional hypercube. |
PathGraph(ExecutionEnvironment env,
long vertexCount)
An undirected
Graph with n vertices where each vertex vi connects
to adjacent vertices vi+1 when i < n-1 and vi-1 when i >
0 . |
RMatGraph(ExecutionEnvironment env,
RandomGenerableFactory<T> randomGeneratorFactory,
long vertexCount,
long edgeCount)
A directed power-law multi
graph generated using the stochastic Recursive Matrix
(R-Mat) model. |
SingletonEdgeGraph(ExecutionEnvironment env,
long vertexPairCount)
An undirected
Graph containing one or more isolated two-paths. |
StarGraph(ExecutionEnvironment env,
long vertexCount)
An undirected
Graph with n vertices where the single central node has degree
n-1 , connecting to the other n-1 vertices which have degree 1 . |
Modifier and Type | Method and Description |
---|---|
ExecutionEnvironment |
MLEnvironment.getExecutionEnvironment()
Get the ExecutionEnvironment.
|
Constructor and Description |
---|
MLEnvironment(ExecutionEnvironment batchEnv,
BatchTableEnvironment batchTableEnv)
Construct with the batch environment and the the batch table environment given by user.
|
MLEnvironment(ExecutionEnvironment batchEnv,
BatchTableEnvironment batchTableEnv,
StreamExecutionEnvironment streamEnv,
StreamTableEnvironment streamTableEnv)
Construct with env given by user.
|
Modifier and Type | Method and Description |
---|---|
DataSet<Row> |
OrcTableSource.getDataSet(ExecutionEnvironment execEnv) |
Modifier and Type | Method and Description |
---|---|
static Configuration |
PythonConfigUtil.getMergedConfig(ExecutionEnvironment env,
TableConfig tableConfig) |
Modifier and Type | Method and Description |
---|---|
static ExistingSavepoint |
Savepoint.load(ExecutionEnvironment env,
String path,
StateBackend stateBackend)
Loads an existing savepoint.
|
Modifier and Type | Method and Description |
---|---|
static BatchTableEnvironment |
BatchTableEnvironment.create(ExecutionEnvironment executionEnvironment)
|
static BatchTableEnvironment |
BatchTableEnvironment.create(ExecutionEnvironment executionEnvironment,
TableConfig tableConfig)
|
Modifier and Type | Method and Description |
---|---|
DataSet<T> |
BatchTableSource.getDataSet(ExecutionEnvironment execEnv)
Deprecated.
Returns the data of the table as a
DataSet . |
DataSet<Row> |
CsvTableSource.getDataSet(ExecutionEnvironment execEnv) |
Modifier and Type | Class and Description |
---|---|
class |
CollectionTestEnvironment
A
CollectionEnvironment to be used in tests. |
class |
TestEnvironment
A
ExecutionEnvironment implementation which executes its jobs on a MiniCluster . |
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.