Graph Algorithms

Graph Algorithms #

The logic blocks with which the Graph API and top-level algorithms are assembled are accessible in Gelly as graph algorithms in the org.apache.flink.graph.asm package. These algorithms provide optimization and tuning through configuration parameters and may provide implicit runtime reuse when processing the same input with a similar configuration.

VertexInDegree #

Annotate vertices of a directed graph with the in-degree.

DataSet<Vertex<K, LongValue>> inDegree = graph
  .run(new VertexInDegree().setIncludeZeroDegreeVertices(true));

Optional Configuration:

  • setIncludeZeroDegreeVertices: by default only the edge set is processed for the computation of degree; when this flag is set an additional join is performed against the vertex set in order to output vertices with an in-degree of zero.

  • setParallelism: override the operator parallelism

VertexOutDegree #

Annotate vertices of a directed graph with the out-degree.

DataSet<Vertex<K, LongValue>> outDegree = graph
  .run(new VertexOutDegree().setIncludeZeroDegreeVertices(true));

Optional Configuration:

  • setIncludeZeroDegreeVertices: by default only the edge set is processed for the computation of degree; when this flag is set an additional join is performed against the vertex set in order to output vertices with an out-degree of zero.

  • setParallelism: override the operator parallelism

VertexDegrees #

Annotate vertices of a directed graph with the degree, out-degree, and in-degree.

DataSet<Vertex<K, Tuple2<LongValue, LongValue>>> degrees = graph
  .run(new VertexDegrees().setIncludeZeroDegreeVertices(true));

Optional configuration:

  • setIncludeZeroDegreeVertices: by default only the edge set is processed for the computation of degree; when this flag is set an additional join is performed against the vertex set in order to output vertices with out- and in-degree of zero.

  • setParallelism: override the operator parallelism.

EdgeSourceDegrees #

Annotate edges of a directed graph with the degree, out-degree, and in-degree of the source ID.

DataSet<Edge<K, Tuple2<EV, Degrees>>> sourceDegrees = graph
  .run(new EdgeSourceDegrees());

Optional configuration:

  • setParallelism: override the operator parallelism.

EdgeTargetDegrees #

Annotate edges of a directed graph with the degree, out-degree, and in-degree of the target ID.

DataSet<Edge<K, Tuple2<EV, Degrees>>> targetDegrees = graph
  .run(new EdgeTargetDegrees());

Optional configuration:

  • setParallelism: override the operator parallelism.

EdgeDegreesPair #

Annotate edges of a directed graph with the degree, out-degree, and in-degree of both the source and target vertices.

DataSet<Vertex<K, LongValue>> degree = graph
  .run(new VertexDegree()
    .setIncludeZeroDegreeVertices(true)
    .setReduceOnTargetId(true));

Optional Configuration:

  • setIncludeZeroDegreeVertices: by default only the edge set is processed for the computation of degree; when this flag is set an additional join is performed against the vertex set in order to output vertices with a degree of zero

  • setParallelism: override the operator parallelism

  • setReduceOnTargetId: the degree can be counted from either the edge source or target IDs. By default the source IDs are counted. Reducing on target IDs may optimize the algorithm if the input edge list is sorted by target ID.

EdgeSourceDegree #

Annotate edges of an undirected graph with degree of the source ID.

DataSet<Edge<K, Tuple2<EV, LongValue>>> sourceDegree = graph
  .run(new EdgeSourceDegree()
    .setReduceOnTargetId(true));

Optional Configuration:

  • setParallelism: override the operator parallelism

  • setReduceOnTargetId: the degree can be counted from either the edge source or target IDs. By default the source IDs are counted. Reducing on target IDs may optimize the algorithm if the input edge list is sorted by target ID.

EdgeTargetDegree #

Annotate edges of an undirected graph with degree of the target ID.

DataSet<Edge<K, Tuple2<EV, LongValue>>> targetDegree = graph
  .run(new EdgeTargetDegree()
    .setReduceOnSourceId(true));

Optional configuration:

  • setParallelism: override the operator parallelism

  • setReduceOnSourceId: the degree can be counted from either the edge source or target IDs. By default the target IDs are counted. Reducing on source IDs may optimize the algorithm if the input edge list is sorted by source ID.

EdgeDegreePair #

Annotate edges of an undirected graph with the degree of both the source and target vertices.

DataSet<Edge<K, Tuple3<EV, LongValue, LongValue>>> pairDegree = graph
  .run(new EdgeDegreePair().setReduceOnTargetId(true));

Optional configuration:

  • setParallelism: override the operator parallelism

  • setReduceOnTargetId: the degree can be counted from either the edge source or target IDs. By default the source IDs are counted. Reducing on target IDs may optimize the algorithm if the input edge list is sorted by target ID.

MaximumDegree #

Filter an undirected graph by maximum degree.

Graph<K, VV, EV> filteredGraph = graph
  .run(new MaximumDegree(5000)
    .setBroadcastHighDegreeVertices(true)
    .setReduceOnTargetId(true));

Optional configuration:

  • setBroadcastHighDegreeVertices: join high-degree vertices using a broadcast-hash to reduce data shuffling when removing a relatively small number of high-degree vertices.

  • setParallelism: override the operator parallelism

  • setReduceOnTargetId: the degree can be counted from either the edge source or target IDs. By default the source IDs are counted. Reducing on target IDs may optimize the algorithm if the input edge list is sorted by target ID.

Simplify #

Remove self-loops and duplicate edges from a directed graph.

graph.run(new Simplify());

TranslateGraphIds #

Translate vertex and edge IDs using the given TranslateFunction.

graph.run(new TranslateGraphIds(new LongValueToStringValue()));

Required configuration:

  • translator: implements type or value conversion

Optional configuration:

  • setParallelism: override the operator parallelism

TranslateVertexValues #

Translate vertex values using the given TranslateFunction.

graph.run(new TranslateVertexValues(new LongValueAddOffset(vertexCount)));

Required configuration:

  • translator: implements type or value conversion

Optional configuration:

  • setParallelism: override the operator parallelism

TranslateEdgeValues #

Translate edge values using the given TranslateFunction.

graph.run(new TranslateEdgeValues(new Nullify()));

Required configuration:

  • translator: implements type or value conversion

Optional configuration:

  • setParallelism: override the operator parallelism

Back to top