Constructor and Description |
---|
DataSink(DataSet<T> data,
OutputFormat<T> format,
TypeInformation<T> type) |
Modifier and Type | Method and Description |
---|---|
DataSet<T> |
getDataSet() |
OutputFormat<T> |
getFormat() |
ResourceSpec |
getMinResources()
Returns the minimum resources of this data sink.
|
int |
getParallelism()
Returns the parallelism of this data sink.
|
Configuration |
getParameters() |
ResourceSpec |
getPreferredResources()
Returns the preferred resources of this data sink.
|
TypeInformation<T> |
getType() |
DataSink<T> |
name(String name) |
DataSink<T> |
setParallelism(int parallelism)
Sets the parallelism for this data sink.
|
DataSink<T> |
sortLocalOutput(int field,
Order order)
Deprecated.
Use
DataSet.sortPartition(int, Order) instead |
DataSink<T> |
sortLocalOutput(String fieldExpression,
Order order)
Deprecated.
Use
DataSet.sortPartition(String, Order) instead |
String |
toString() |
protected GenericDataSinkBase<T> |
translateToDataFlow(Operator<T> input) |
DataSink<T> |
withParameters(Configuration parameters)
Pass a configuration to the OutputFormat.
|
public DataSink(DataSet<T> data, OutputFormat<T> format, TypeInformation<T> type)
@Internal public OutputFormat<T> getFormat()
@Internal public TypeInformation<T> getType()
public DataSink<T> withParameters(Configuration parameters)
parameters
- Configuration parameters@Deprecated @PublicEvolving public DataSink<T> sortLocalOutput(int field, Order order)
DataSet.sortPartition(int, Order)
insteadTuple
data set
on the specified field in the specified Order
before it is emitted by the output format.
Note: Only tuple data sets can be sorted using integer field indices.
The tuple data set can be sorted on multiple fields in different orders
by chaining sortLocalOutput(int, Order)
calls.
@Deprecated @PublicEvolving public DataSink<T> sortLocalOutput(String fieldExpression, Order order)
DataSet.sortPartition(String, Order)
insteadOrder
before it is emitted by the output format.
Note: Non-composite types can only be sorted on the full element which is specified by a wildcard expression ("*" or "_").
Data sets of composite types (Tuple or Pojo) can be sorted on multiple fields in different orders
by chaining sortLocalOutput(String, Order)
calls.
fieldExpression
- The field expression for the field(s) on which the data set is locally sorted.order
- The Order in which the specified field(s) are locally sorted.Order
public Configuration getParameters()
protected GenericDataSinkBase<T> translateToDataFlow(Operator<T> input)
public int getParallelism()
public DataSink<T> setParallelism(int parallelism)
parallelism
- The parallelism for this data sink. A value equal to ExecutionConfig.PARALLELISM_DEFAULT
will use the system default.@PublicEvolving public ResourceSpec getMinResources()
@PublicEvolving public ResourceSpec getPreferredResources()
Copyright © 2014–2019 The Apache Software Foundation. All rights reserved.