org.apache.flink.api.java.operators

Class DataSink<T>

java.lang.Object

org.apache.flink.api.java.operators.DataSink<T>

Type Parameters:

T -

Deprecated.

All Flink DataSet APIs are deprecated since Flink 1.18 and will be removed in a future Flink major version. You can still build your application in DataSet, but you should move to either the DataStream and/or Table API.

@Deprecated
 @Public
public class DataSink<T>
extends Object

An operation that allows storing data results.

See Also:

FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API

Constructor Summary

Constructors

Constructor and Description
DataSink(DataSet<T> data, OutputFormat<T> format, TypeInformation<T> type) Deprecated.

Method Summary

Modifier and Type	Method and Description
DataSet<T>	getDataSet() Deprecated.
OutputFormat<T>	getFormat() Deprecated.
ResourceSpec	getMinResources() Deprecated. Returns the minimum resources of this data sink.
int	getParallelism() Deprecated. Returns the parallelism of this data sink.
Configuration	getParameters() Deprecated.
ResourceSpec	getPreferredResources() Deprecated. Returns the preferred resources of this data sink.
TypeInformation<T>	getType() Deprecated.
DataSink<T>	name(String name) Deprecated.
DataSink<T>	setParallelism(int parallelism) Deprecated. Sets the parallelism for this data sink.
DataSink<T>	sortLocalOutput(int field, Order order) Deprecated. Use DataSet.sortPartition(int, Order) instead
DataSink<T>	sortLocalOutput(String fieldExpression, Order order) Deprecated. Use DataSet.sortPartition(String, Order) instead
String	toString() Deprecated.
protected GenericDataSinkBase<T>	translateToDataFlow(Operator<T> input) Deprecated.
DataSink<T>	withParameters(Configuration parameters) Deprecated. Pass a configuration to the OutputFormat.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DataSink

public DataSink(DataSet<T> data,
                OutputFormat<T> format,
                TypeInformation<T> type)

Deprecated.

Method Detail

getFormat

@Internal
public OutputFormat<T> getFormat()

Deprecated.

getType

@Internal
public TypeInformation<T> getType()

Deprecated.

getDataSet

@Internal
public DataSet<T> getDataSet()

Deprecated.

withParameters

public DataSink<T> withParameters(Configuration parameters)

Deprecated.

Pass a configuration to the OutputFormat.

Parameters:

parameters - Configuration parameters

sortLocalOutput

@Deprecated
 @PublicEvolving
public DataSink<T> sortLocalOutput(int field,
                                                                Order order)

Deprecated. Use DataSet.sortPartition(int, Order) instead

Sorts each local partition of a Tuple data set on the specified field in the specified Order before it is emitted by the output format.

Note: Only tuple data sets can be sorted using integer field indices.

The tuple data set can be sorted on multiple fields in different orders by chaining sortLocalOutput(int, Order) calls.

Parameters:

field - The Tuple field on which the data set is locally sorted.

order - The Order in which the specified Tuple field is locally sorted.

Returns:

This data sink operator with specified output order.

See Also:

Tuple, Order

sortLocalOutput

@Deprecated
 @PublicEvolving
public DataSink<T> sortLocalOutput(String fieldExpression,
                                                                Order order)

Deprecated. Use DataSet.sortPartition(String, Order) instead

Sorts each local partition of a data set on the field(s) specified by the field expression in the specified Order before it is emitted by the output format.

Note: Non-composite types can only be sorted on the full element which is specified by a wildcard expression ("*" or "_").

Data sets of composite types (Tuple or Pojo) can be sorted on multiple fields in different orders by chaining sortLocalOutput(String, Order) calls.

Parameters:

fieldExpression - The field expression for the field(s) on which the data set is locally sorted.

order - The Order in which the specified field(s) are locally sorted.

Returns:

This data sink operator with specified output order.

See Also:

Order

getParameters

public Configuration getParameters()

Deprecated.

Returns:

Configuration for the OutputFormat.

name

public DataSink<T> name(String name)

Deprecated.

translateToDataFlow

protected GenericDataSinkBase<T> translateToDataFlow(Operator<T> input)

Deprecated.

toString

public String toString()

Deprecated.

Overrides:

toString in class Object

getParallelism

public int getParallelism()

Deprecated.

Returns the parallelism of this data sink.

Returns:

The parallelism of this data sink.

setParallelism

public DataSink<T> setParallelism(int parallelism)

Deprecated.

Sets the parallelism for this data sink. The degree must be 1 or more.

Parameters:

parallelism - The parallelism for this data sink. A value equal to ExecutionConfig.PARALLELISM_DEFAULT will use the system default.

Returns:

This data sink with set parallelism.

getMinResources

@PublicEvolving
public ResourceSpec getMinResources()

Deprecated.

Returns the minimum resources of this data sink. If no minimum resources have been set, this returns the default resource profile.

Returns:

The minimum resources of this data sink.

getPreferredResources

@PublicEvolving
public ResourceSpec getPreferredResources()

Deprecated.

Returns the preferred resources of this data sink. If no preferred resources have been set, this returns the default resource profile.

Returns:

The preferred resources of this data sink.