Modifier and Type | Class and Description |
---|---|
class |
BinaryInputFormat<T>
Base class for all input formats that use blocks of fixed size.
|
class |
DelimitedInputFormat<OT>
Base implementation for input formats that split the input at a delimiter into records.
|
class |
FileInputFormat<OT>
The base class for
RichInputFormat s that read from files. |
class |
GenericCsvInputFormat<OT> |
class |
GenericInputFormat<OT>
Generic base class for all Rich inputs that are not based on files.
|
class |
ReplicatingInputFormat<OT,S extends InputSplit>
A ReplicatingInputFormat replicates any
InputFormat to all parallel instances of a
DataSource, i.e., the full input of the replicated InputFormat is completely processed by each
parallel instance of the DataSource. |
class |
RichInputFormat<OT,T extends InputSplit>
An abstract stub implementation for Rich input formats.
|
class |
SerializedInputFormat<T extends IOReadableWritable>
Reads elements by deserializing them with their regular serialization/deserialization
functionality.
|
Modifier and Type | Method and Description |
---|---|
InputFormat<OT,S> |
ReplicatingInputFormat.getReplicatedInputFormat() |
Constructor and Description |
---|
ReplicatingInputFormat(InputFormat<OT,S> wrappedIF) |
Modifier and Type | Class and Description |
---|---|
class |
GenericDataSourceBase<OUT,T extends InputFormat<OUT,?>>
Abstract superclass for data sources in a Pact plan.
|
Modifier and Type | Method and Description |
---|---|
<X> DataSource<X> |
ExecutionEnvironment.createInput(InputFormat<X,?> inputFormat)
Generic method to create an input
DataSet with in InputFormat . |
<X> DataSource<X> |
ExecutionEnvironment.createInput(InputFormat<X,?> inputFormat,
TypeInformation<X> producedType)
Generic method to create an input DataSet with in
InputFormat . |
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatCommonBase<T,SPITTYPE extends InputSplit>
A common base for both "mapred" and "mapreduce" Hadoop input formats.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormat<K,V>
Wrapper for using HadoopInputFormats (mapred-variant) with Flink.
|
class |
HadoopInputFormatBase<K,V,T>
Common base for Java and Scala API for using Hadoop input formats with Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
CollectionInputFormat<T>
An input format that returns objects from a collection.
|
class |
CsvInputFormat<OUT>
InputFormat that reads csv files.
|
class |
IteratorInputFormat<T>
An input format that returns objects from an iterator.
|
class |
ParallelIteratorInputFormat<T>
An input format that generates data in parallel through a
SplittableIterator . |
class |
PojoCsvInputFormat<OUT>
Input format that reads csv into POJOs.
|
class |
PrimitiveInputFormat<OT>
An input format that reads single field primitive data from a given file.
|
class |
RowCsvInputFormat
Input format that reads csv into
Row . |
class |
TextInputFormat
Input Format that reads text files.
|
class |
TextValueInputFormat
Input format that reads text files.
|
class |
TupleCsvInputFormat<OUT>
Input format that reads csv into tuples.
|
class |
TypeSerializerInputFormat<T>
Reads elements by deserializing them with a given type serializer.
|
Modifier and Type | Method and Description |
---|---|
InputFormat<OUT,?> |
DataSource.getInputFormat()
Gets the input format that is executed by this data source.
|
Constructor and Description |
---|
DataSource(ExecutionEnvironment context,
InputFormat<OUT,?> inputFormat,
TypeInformation<OUT> type,
String dataSourceLocationName)
Creates a new data source.
|
Modifier and Type | Method and Description |
---|---|
static <IN> TypeInformation<IN> |
TypeExtractor.getInputFormatTypes(InputFormat<IN,?> inputFormatInterface) |
Modifier and Type | Class and Description |
---|---|
class |
CassandraInputFormat<OUT extends Tuple>
InputFormat to read data from Apache Cassandra and generate $
Tuple . |
class |
CassandraInputFormatBase<OUT>
Base class for
RichInputFormat to read data from Apache Cassandra and generate a custom
Cassandra annotated object. |
class |
CassandraPojoInputFormat<OUT>
InputFormat to read data from Apache Cassandra and generate a custom Cassandra annotated object.
|
Modifier and Type | Class and Description |
---|---|
class |
Generator
InputFormat that generates a deterministic DataSet of Tuple2(String, Integer)
String: key, can be repeated.
|
Modifier and Type | Method and Description |
---|---|
protected abstract InputFormat<RowData,?> |
AbstractHBaseDynamicTableSource.getInputFormat() |
Modifier and Type | Class and Description |
---|---|
class |
AbstractTableInputFormat<T>
Abstract
InputFormat to read data from HBase tables. |
class |
HBaseRowDataInputFormat
InputFormat subclass that wraps the access for HTables. |
Modifier and Type | Method and Description |
---|---|
InputFormat<RowData,?> |
HBaseDynamicTableSource.getInputFormat() |
Modifier and Type | Method and Description |
---|---|
protected InputFormat<RowData,?> |
HBaseDynamicTableSource.getInputFormat() |
Modifier and Type | Class and Description |
---|---|
class |
JdbcInputFormat
InputFormat to read data from a database and generate Rows.
|
Modifier and Type | Class and Description |
---|---|
class |
JdbcRowDataInputFormat
InputFormat for
JdbcDynamicTableSource . |
Modifier and Type | Class and Description |
---|---|
class |
HiveTableFileInputFormat
A
FileInputFormat that wraps a HiveTableInputFormat . |
class |
HiveTableInputFormat
The HiveTableInputFormat are inspired by the HCatInputFormat and HadoopInputFormatBase.
|
Modifier and Type | Class and Description |
---|---|
class |
FileCopyTaskInputFormat
An implementation of an input format that dynamically assigns
FileCopyTask to the mappers
that have finished previously assigned tasks. |
Modifier and Type | Class and Description |
---|---|
class |
AvroInputFormat<E>
Provides a
FileInputFormat for Avro records. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractCsvInputFormat<T>
Input format that reads csv.
|
Modifier and Type | Class and Description |
---|---|
class |
HCatInputFormatBase<T>
A InputFormat to read from HCatalog tables.
|
Modifier and Type | Class and Description |
---|---|
class |
HCatInputFormat<T>
A InputFormat to read from HCatalog tables.
|
Modifier and Type | Method and Description |
---|---|
Map<OperatorID,UserCodeWrapper<? extends InputFormat<?,?>>> |
InputOutputFormatContainer.getInputFormats() |
Map<OperatorID,UserCodeWrapper<? extends InputFormat<?,?>>> |
InputOutputFormatContainer.FormatUserCodeTable.getInputFormats() |
<OT,T extends InputSplit> |
InputOutputFormatContainer.getUniqueInputFormat() |
Modifier and Type | Method and Description |
---|---|
InputOutputFormatContainer |
InputOutputFormatContainer.addInputFormat(OperatorID operatorId,
InputFormat<?,?> inputFormat) |
Modifier and Type | Method and Description |
---|---|
InputOutputFormatContainer |
InputOutputFormatContainer.addInputFormat(OperatorID operatorId,
UserCodeWrapper<? extends InputFormat<?,?>> wrapper) |
void |
InputOutputFormatContainer.FormatUserCodeTable.addInputFormat(OperatorID operatorId,
UserCodeWrapper<? extends InputFormat<?,?>> wrapper) |
Modifier and Type | Method and Description |
---|---|
InputFormat<Row,?> |
BatchSQLTestProgram.GeneratorTableSource.getInputFormat() |
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateInputFormat<K,V>
The input format for reading
BroadcastState . |
class |
KeyedStateInputFormat<K,N,OUT>
Input format for reading partitioned state.
|
class |
ListStateInputFormat<OT>
Input format for reading operator list state.
|
class |
UnionStateInputFormat<OT>
Input format for reading operator union state.
|
Modifier and Type | Method and Description |
---|---|
static <OUT> DataStreamSource<OUT> |
SourceBuilder.fromFormat(StreamExecutionEnvironment env,
InputFormat<OUT,?> inputFormat,
TypeInformation<OUT> typeInfo)
Creates a new source that is bounded.
|
Modifier and Type | Method and Description |
---|---|
<OUT> DataStreamSource<OUT> |
StreamExecutionEnvironment.createInput(InputFormat<OUT,?> inputFormat)
Generic method to create an input data stream with
InputFormat . |
<OUT> DataStreamSource<OUT> |
StreamExecutionEnvironment.createInput(InputFormat<OUT,?> inputFormat,
TypeInformation<OUT> typeInfo)
Generic method to create an input data stream with
InputFormat . |
Modifier and Type | Method and Description |
---|---|
InputFormat<OUT,InputSplit> |
InputFormatSourceFunction.getFormat()
Returns the
InputFormat . |
Constructor and Description |
---|
ContinuousFileReaderOperatorFactory(InputFormat<OUT,? super T> inputFormat) |
ContinuousFileReaderOperatorFactory(InputFormat<OUT,? super T> inputFormat,
TypeInformation<OUT> type,
ExecutionConfig executionConfig) |
InputFormatSourceFunction(InputFormat<OUT,?> format,
TypeInformation<OUT> typeInfo) |
Modifier and Type | Method and Description |
---|---|
InputFormat<?,?> |
StreamNode.getInputFormat() |
Modifier and Type | Method and Description |
---|---|
void |
StreamNode.setInputFormat(InputFormat<?,?> inputFormat) |
void |
StreamGraph.setInputFormat(Integer vertexID,
InputFormat<?,?> inputFormat) |
Modifier and Type | Method and Description |
---|---|
InputFormat<OUT,InputSplit> |
SimpleInputFormatOperatorFactory.getInputFormat() |
InputFormat<OUT,InputSplit> |
InputFormatOperatorFactory.getInputFormat() |
Modifier and Type | Method and Description |
---|---|
static <T> InputFormat<T,?> |
PythonTypeUtils.getCollectionInputFormat(List<T> data,
TypeInformation<T> dataType,
ExecutionConfig config)
Wrap the unpickled python data with an InputFormat.
|
Modifier and Type | Method and Description |
---|---|
InputFormat<RowData,?> |
InputFormatProvider.createInputFormat()
Creates an
InputFormat instance. |
Modifier and Type | Method and Description |
---|---|
static InputFormatProvider |
InputFormatProvider.of(InputFormat<RowData,?> inputFormat)
Helper method for creating a static provider.
|
Modifier and Type | Method and Description |
---|---|
protected <IN> Transformation<IN> |
BatchExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> inputFormat,
TypeInformation<IN> typeInfo) |
Transformation<RowData> |
BatchExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName) |
Modifier and Type | Method and Description |
---|---|
protected abstract <IN> Transformation<IN> |
CommonExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> inputFormat,
TypeInformation<IN> typeInfo) |
protected abstract Transformation<RowData> |
CommonExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName)
Creates a
Transformation based on the given InputFormat . |
Modifier and Type | Method and Description |
---|---|
protected <IN> Transformation<IN> |
StreamExecLegacyTableSourceScan.createInput(StreamExecutionEnvironment env,
InputFormat<IN,? extends InputSplit> format,
TypeInformation<IN> typeInfo) |
Transformation<RowData> |
StreamExecTableSourceScan.createInputFormatTransformation(StreamExecutionEnvironment env,
InputFormat<RowData,?> inputFormat,
InternalTypeInfo<RowData> outputTypeInfo,
String operatorName) |
Constructor and Description |
---|
InputFormatCacheLoader(InputFormat<RowData,?> initialInputFormat,
GenericRowDataKeySelector keySelector,
RowDataSerializer cacheEntriesSerializer) |
InputSplitCacheLoadTask(ConcurrentHashMap<RowData,Collection<RowData>> cache,
GenericRowDataKeySelector keySelector,
RowDataSerializer cacheEntriesSerializer,
InputFormat<RowData,InputSplit> inputFormat,
InputSplit inputSplit) |
Modifier and Type | Class and Description |
---|---|
class |
GeneratedInput<F extends InputFormat<?,?>>
Describes a generated
InputFormat . |
Modifier and Type | Class and Description |
---|---|
class |
ValuesInputFormat
Generated ValuesInputFormat.
|
Modifier and Type | Method and Description |
---|---|
abstract InputFormat<T,?> |
InputFormatTableSource.getInputFormat()
Deprecated.
Returns an
InputFormat for reading the data of the table. |
Modifier and Type | Method and Description |
---|---|
static InputFormat<RowData,?> |
PythonTableUtils.getInputFormat(List<Object[]> data,
DataType dataType)
Wrap the unpickled python data with an InputFormat.
|
Modifier and Type | Class and Description |
---|---|
class |
TransactionRowInputFormat
An bounded input of transactions.
|
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.