Modifier and Type | Class and Description |
---|---|
class |
HBaseConfigurationUtil
This class helps to do serialization for hadoop Configuration.
|
class |
HBaseTypeUtils
A utility class to process data exchange with HBase type system.
|
Modifier and Type | Class and Description |
---|---|
interface |
VisibleForTesting
This annotations declares that a function, field, constructor, or entire type, is only visible for
testing purposes.
|
Modifier and Type | Class and Description |
---|---|
interface |
ConfigGroup
A class that specifies a group of config options.
|
interface |
ConfigGroups
Annotation used on classes containing config options that enables the separation of options into different
tables based on key prefixes.
|
static interface |
Documentation.CommonOption
Annotation used on config option fields to include them in the "Common Options" section.
|
static interface |
Documentation.ExcludeFromDocumentation
Annotation used on config option fields to exclude the config option from documentation.
|
static interface |
Documentation.OverrideDefault
Annotation used on config option fields to override the documented default.
|
static interface |
Documentation.TableOption
Annotation used on table config options for adding meta data labels.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Archiveable<T extends Serializable> |
class |
ArchivedExecutionConfig
Serializable class which is created when archiving the job.
|
class |
Plan
This class represents Flink programs, in the form of dataflow plans.
|
class |
PlanExecutor
A PlanExecutor executes a Flink program's dataflow plan.
|
class |
TaskInfo
Encapsulates task-specific information: name, index of subtask, parallelism and attempt number.
|
Modifier and Type | Method and Description |
---|---|
ArchivedExecutionConfig |
ExecutionConfig.archive() |
boolean |
ExecutionConfig.isFailTaskOnCheckpointError()
Deprecated.
This method takes no effect since we would not forward the configuration from the checkpoint config
to the task, and we have not supported task to fail on checkpoint error.
Please use CheckpointConfig.getTolerableCheckpointFailureNumber() to know the behavior on checkpoint errors.
|
boolean |
ExecutionConfig.isLatencyTrackingConfigured() |
void |
ExecutionConfig.setFailTaskOnCheckpointError(boolean failTaskOnCheckpointError)
Deprecated.
This method takes no effect since we would not forward the configuration from the checkpoint config
to the task, and we have not supported task to fail on checkpoint error.
Please use CheckpointConfig.setTolerableCheckpointFailureNumber(int) to determine the behavior on checkpoint errors.
|
Modifier and Type | Class and Description |
---|---|
class |
AccumulatorHelper
Helper functions for the interaction with
Accumulator . |
Modifier and Type | Class and Description |
---|---|
class |
AggregatorRegistry
A registry for iteration
Aggregator s. |
Modifier and Type | Class and Description |
---|---|
class |
CommonRangeBoundaries<T> |
Modifier and Type | Class and Description |
---|---|
class |
AbstractRuntimeUDFContext
A standalone implementation of the
RuntimeContext , created by runtime UDF operators. |
class |
CopyingIterator<E>
Wraps an iterator to return deep copies of the original iterator's elements.
|
class |
CopyingListCollector<T>
A
Collector that collects deep copies of its elements in a list. |
class |
FunctionUtils
Utility class that contains helper methods to work with Flink
Function class. |
class |
ListCollector<T>
A
Collector that puts the collected elements into a given list. |
class |
NoOpFunction
An
AbstractRichFunction that does nothing. |
class |
PrintSinkOutputWriter<IN>
Print sink output writer for DataStream and DataSet print API.
|
class |
RuntimeUDFContext
A standalone implementation of the
RuntimeContext , created by runtime UDF operators. |
Modifier and Type | Method and Description |
---|---|
String |
AbstractRuntimeUDFContext.getAllocationIDAsString() |
Modifier and Type | Class and Description |
---|---|
class |
DefaultInputSplitAssigner
This is the default implementation of the
InputSplitAssigner interface. |
class |
GenericCsvInputFormat<OT> |
class |
GlobFilePathFilter
Class for determining if a particular file should be included or excluded
based on a set of include and exclude glob filters.
|
class |
ReplicatingInputSplitAssigner
Assigns each InputSplit to each requesting parallel instance.
|
Modifier and Type | Class and Description |
---|---|
class |
Bzip2InputStreamFactory
Factory for Bzip2 decompressors.
|
class |
DeflateInflaterInputStreamFactory
Factory for input streams that decompress the "deflate" compression format.
|
class |
GzipInflaterInputStreamFactory
Factory for input streams that decompress the GZIP compression format.
|
interface |
InflaterInputStreamFactory<T extends InputStream>
Creates a new instance of a certain subclass of
InflaterInputStream . |
class |
XZInputStreamFactory
Factory for XZ decompressors.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractUdfOperator<OUT,FT extends Function>
Abstract superclass for all contracts that represent actual operators.
|
class |
BinaryOperatorInformation<IN1,IN2,OUT>
A class for holding information about a single input operator, such as input/output TypeInformation.
|
class |
CollectionExecutor
Execution utility for serial, local, collection-based executions of Flink programs.
|
class |
CompilerHints
A class encapsulating compiler hints describing the behavior of the user function.
|
class |
DualInputOperator<IN1,IN2,OUT,FT extends Function>
Abstract operator superclass for all operators that have two inputs, like "Join", "CoGroup", or "Cross".
|
class |
DualInputSemanticProperties
Container for the semantic properties associated to a dual input operator.
|
class |
GenericDataSinkBase<IN>
Operator for nodes that act as data sinks, storing the data they receive.
|
class |
GenericDataSourceBase<OUT,T extends InputFormat<OUT,?>>
Abstract superclass for data sources in a Pact plan.
|
interface |
IterationOperator |
class |
Keys<T> |
class |
Operator<OUT>
Abstract base class for all operators.
|
class |
OperatorInformation<OUT>
A class for holding information about an operator, such as input/output TypeInformation.
|
class |
Ordering
This class represents an ordering on a set of fields.
|
class |
ResourceSpec
Describe the different resource factors of the operator with UDF.
|
interface |
SemanticProperties
Container for the semantic properties associated to an operator.
|
class |
SingleInputOperator<IN,OUT,FT extends Function>
Abstract superclass for for all operators that have one input like "map" or "reduce".
|
class |
SingleInputSemanticProperties
Container for the semantic properties associated to a single input operator.
|
class |
UnaryOperatorInformation<IN,OUT>
A class for holding information about a single input operator, such as input/output TypeInformation.
|
class |
Union<T>
This operator represents a Union between two inputs.
|
Modifier and Type | Class and Description |
---|---|
class |
BulkIterationBase<T> |
class |
CoGroupOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>> |
class |
CoGroupRawOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>> |
class |
CrossOperatorBase<IN1,IN2,OUT,FT extends CrossFunction<IN1,IN2,OUT>> |
class |
DeltaIterationBase<ST,WT>
A DeltaIteration is similar to a
BulkIterationBase ,
but maintains state across the individual iteration steps. |
class |
FilterOperatorBase<T,FT extends FlatMapFunction<T,T>> |
class |
FlatMapOperatorBase<IN,OUT,FT extends FlatMapFunction<IN,OUT>> |
class |
GroupCombineOperatorBase<IN,OUT,FT extends GroupCombineFunction<IN,OUT>>
Base operator for the combineGroup transformation.
|
class |
GroupReduceOperatorBase<IN,OUT,FT extends GroupReduceFunction<IN,OUT>> |
class |
InnerJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
JoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
MapOperatorBase<IN,OUT,FT extends MapFunction<IN,OUT>> |
class |
MapPartitionOperatorBase<IN,OUT,FT extends MapPartitionFunction<IN,OUT>> |
class |
OuterJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
PartitionOperatorBase<IN> |
class |
ReduceOperatorBase<T,FT extends ReduceFunction<T>>
Base data flow operator for Reduce user-defined functions.
|
class |
SortPartitionOperatorBase<IN> |
Modifier and Type | Class and Description |
---|---|
class |
FieldList
Immutable ordered list of fields IDs.
|
class |
FieldSet
Immutable unordered collection of fields IDs.
|
class |
JoinHashMap<BT> |
class |
ListKeyGroupedIterator<E>
The KeyValueIterator returns a key and all values that belong to the key (share the same key).
|
class |
TypeComparable<T>
Wrapper that is used to store elements for which we have a TypeComparator in a Hash Map.
|
class |
UserCodeClassWrapper<T>
This holds a class containing user defined code.
|
class |
UserCodeObjectWrapper<T>
This holds an actual object containing user defined code.
|
interface |
UserCodeWrapper<T>
UDf operators can have either a class or an object containing the user
code, this is the common interface to access them.
|
Modifier and Type | Class and Description |
---|---|
class |
GPUResource
The GPU resource.
|
class |
Resource
Base class for resources one can specify.
|
Modifier and Type | Method and Description |
---|---|
StateTtlConfig |
StateDescriptor.getTtlConfig() |
Modifier and Type | Class and Description |
---|---|
class |
Deadline
This class stores a deadline, as obtained via
Deadline.now() or from Deadline.plus(Duration) . |
Modifier and Type | Class and Description |
---|---|
class |
BackwardsCompatibleSerializerSnapshot<T>
A utility
TypeSerializerConfigSnapshot that is used for backwards compatibility purposes. |
class |
CompositeTypeSerializerConfigSnapshot<T>
A
TypeSerializerConfigSnapshot for serializers that has multiple nested serializers. |
class |
CompositeTypeSerializerUtil
Utilities for the
CompositeTypeSerializerSnapshot . |
class |
GenericPairComparator<T1,T2> |
class |
GenericTypeSerializerConfigSnapshot<T>
Configuration snapshot for serializers for generic types.
|
class |
GenericTypeSerializerSnapshot<T,S extends TypeSerializer>
Base
TypeSerializerSnapshot for serializers for generic types. |
interface |
LegacySerializerSnapshotTransformer<T>
This interface provides a way for
TypeSerializer s to transform a legacy TypeSerializerSnapshot
used in versions before Flink 1.7 during deserialization. |
class |
NestedSerializersSnapshotDelegate
A NestedSerializersSnapshotDelegate represents the snapshots of multiple serializers that are used
by an outer serializer.
|
class |
ParameterlessTypeSerializerConfig<T>
Deprecated.
this snapshot class is no longer used by any serializers, and is maintained only
for backward compatibility reasons. It is fully replaced by
SimpleTypeSerializerSnapshot . |
class |
SameTypePairComparator<T> |
class |
SingleThreadAccessCheckingTypeSerializer<T> |
interface |
TypeComparatorFactory<T> |
class |
TypePairComparator<T1,T2>
This interface defines the method required by the runtime to use data types in join-like operations.
|
interface |
TypePairComparatorFactory<T1,T2> |
static interface |
TypeSerializerConfigSnapshot.SelfResolvingTypeSerializer<E>
Deprecated.
This interface assists with the migration path to the new serialization abstraction.
|
interface |
TypeSerializerFactory<T> |
class |
TypeSerializerSerializationUtil
Deprecated.
This utility class was used to write serializers into checkpoints.
Starting from Flink 1.6.x, this should no longer happen, and therefore
this class is deprecated. It remains here for backwards compatibility paths.
|
Modifier and Type | Method and Description |
---|---|
ClassLoader |
TypeSerializerConfigSnapshot.getUserCodeClassLoader()
Deprecated.
Returns the user code class loader.
|
void |
TypeSerializerConfigSnapshot.setPriorSerializer(TypeSerializer<T> serializer)
Deprecated.
Set the originating serializer of this configuration snapshot.
|
void |
TypeSerializerConfigSnapshot.setUserCodeClassLoader(ClassLoader userCodeClassLoader)
Deprecated.
Set the user code class loader.
|
Modifier and Type | Class and Description |
---|---|
class |
BasicTypeComparator<T extends Comparable<T>> |
class |
BigDecComparator
Comparator for comparing BigDecimal values.
|
class |
BigDecSerializer
Serializer for serializing/deserializing BigDecimal values including null values.
|
class |
BigIntComparator
Comparator for comparing BigInteger values.
|
class |
BigIntSerializer
Serializer for serializing/deserializing BigInteger values including null values.
|
class |
BooleanComparator |
class |
BooleanSerializer
Type serializer for
Boolean . |
class |
BooleanValueComparator
Specialized comparator for BooleanValue based on CopyableValueComparator.
|
class |
BooleanValueSerializer |
class |
ByteComparator |
class |
ByteSerializer
Type serializer for
Byte . |
class |
ByteValueComparator
Specialized comparator for ByteValue based on CopyableValueComparator.
|
class |
ByteValueSerializer |
class |
CharComparator |
class |
CharSerializer
Type serializer for
Character . |
class |
CharValueComparator
Specialized comparator for CharValue based on CopyableValueComparator.
|
class |
CharValueSerializer |
class |
CollectionSerializerConfigSnapshot<C extends Collection<T>,T>
Deprecated.
this snapshot class should no longer be used by any serializers as their snapshot.
|
class |
DateComparator |
class |
DateSerializer |
class |
DoubleComparator |
class |
DoubleSerializer
Type serializer for
Double . |
class |
DoubleValueComparator
Specialized comparator for DoubleValue based on CopyableValueComparator.
|
class |
DoubleValueSerializer |
class |
EnumComparator<T extends Enum<T>> |
class |
EnumSerializer<T extends Enum<T>>
TypeSerializer for Java enums. |
class |
FloatComparator |
class |
FloatSerializer
Type serializer for
Float . |
class |
FloatValueComparator
Specialized comparator for FloatValue based on CopyableValueComparator.
|
class |
FloatValueSerializer |
class |
GenericArraySerializer<C>
A serializer for arrays of objects.
|
class |
GenericArraySerializerConfigSnapshot<C>
Deprecated.
this is deprecated and no longer used by the
GenericArraySerializer .
It has been replaced by GenericArraySerializerSnapshot . |
class |
InstantComparator
Comparator for comparing Java Instant.
|
class |
InstantSerializer
Serializer for serializing/deserializing Instant values including null values.
|
class |
IntComparator |
class |
IntSerializer
Type serializer for
Integer (and int , via auto-boxing). |
class |
IntValueComparator
Specialized comparator for IntValue based on CopyableValueComparator.
|
class |
IntValueSerializer |
class |
ListSerializer<T>
A serializer for
Lists . |
class |
LocalDateComparator
This class can not extend
BasicTypeComparator , because LocalDate is a
Comparable of ChronoLocalDate instead of Comparable of LocalDate. |
class |
LocalDateSerializer |
class |
LocalDateTimeComparator
This class can not extend
BasicTypeComparator , because LocalDateTime is a
Comparable of ChronoLocalDateTime instead of Comparable of LocalDateTime. |
class |
LocalDateTimeSerializer |
class |
LocalTimeComparator |
class |
LocalTimeSerializer |
class |
LongComparator |
class |
LongSerializer
Type serializer for
Long . |
class |
LongValueComparator
Specialized comparator for LongValue based on CopyableValueComparator.
|
class |
LongValueSerializer |
class |
MapSerializer<K,V>
A serializer for
Map . |
class |
MapSerializerConfigSnapshot<K,V>
Deprecated.
this snapshot class should not be used by any serializer anymore.
|
class |
NormalizedKeyUtil
Utilities related to
TypeComparator . |
class |
NullValueComparator
Specialized comparator for NullValue based on CopyableValueComparator.
|
class |
NullValueSerializer |
class |
ShortComparator |
class |
ShortSerializer
Type serializer for
Byte . |
class |
ShortValueComparator
Specialized comparator for ShortValue based on CopyableValueComparator.
|
class |
ShortValueSerializer |
class |
SqlDateSerializer |
class |
SqlTimeSerializer |
class |
SqlTimestampComparator
Comparator for comparing Java SQL Timestamps.
|
class |
SqlTimestampSerializer |
class |
StringComparator |
class |
StringSerializer
Type serializer for
String . |
class |
StringValueComparator
Specialized comparator for StringValue based on CopyableValueComparator.
|
class |
StringValueSerializer |
class |
TypeSerializerSingleton<T> |
class |
VoidSerializer
Serializer for
Void . |
Modifier and Type | Class and Description |
---|---|
class |
Transformation<T>
A
Transformation represents the operation that creates a
DataStream. |
Modifier and Type | Class and Description |
---|---|
class |
ClosureCleaner
The closure cleaner is a utility that tries to truncate the closure (enclosing instance)
of non-static inner classes (created for inline transformation functions).
|
class |
Utils
Utility class that contains helper methods to work with Java APIs.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
ExecutionEnvironment.areExplicitEnvironmentsAllowed()
Checks whether it is currently permitted to explicitly instantiate a LocalEnvironment
or a RemoteEnvironment.
|
Plan |
ExecutionEnvironment.createProgramPlan()
Creates the program's
Plan . |
Plan |
ExecutionEnvironment.createProgramPlan(String jobName)
Creates the program's
Plan . |
Plan |
ExecutionEnvironment.createProgramPlan(String jobName,
boolean clearSinks)
Creates the program's
Plan . |
Modifier and Type | Class and Description |
---|---|
class |
AggregationFunction<T> |
interface |
AggregationFunctionFactory
Interface of factory for creating
AggregationFunction . |
class |
MaxAggregationFunction<T extends Comparable<T>>
Implementation of
AggregationFunction for max operation. |
class |
MinAggregationFunction<T extends Comparable<T>>
Implementations of
AggregationFunction for min operation. |
class |
SumAggregationFunction<T>
Definitions of sum functions for different numerical types.
|
Modifier and Type | Class and Description |
---|---|
class |
FirstReducer<T>
Reducer that only emits the first N elements in a group.
|
class |
FormattingMapper<T>
Mapper that converts values to strings using a
TextOutputFormat.TextFormatter . |
class |
IdPartitioner
Partitioner that partitions by id.
|
class |
NullByteKeySelector<T>
Used as a dummy
KeySelector to allow using keyed operators
for non-keyed use cases. |
class |
SampleInCoordinator<T>
SampleInCoordinator wraps the sample logic of the coordinator side (the second phase of
distributed sample algorithm).
|
class |
SampleInPartition<T>
SampleInPartition wraps the sample logic on the partition side (the first phase of distributed
sample algorithm).
|
class |
SampleWithFraction<T>
A map partition function wrapper for sampling algorithms with fraction, the sample algorithm
takes the partition iterator as input.
|
class |
SelectByMaxFunction<T extends Tuple>
Function that enables selection by maximal value of a field.
|
class |
SelectByMinFunction<T extends Tuple>
Function that enables selection by minimal value of a field.
|
class |
SemanticPropUtil
Utility class that contains helper methods to work with
SemanticProperties . |
Modifier and Type | Method and Description |
---|---|
static Set<Annotation> |
FunctionAnnotation.readDualForwardAnnotations(Class<?> udfClass)
Reads the annotations of a user defined function with two inputs and returns semantic properties according to the forwarded fields annotated.
|
static Set<Annotation> |
FunctionAnnotation.readSingleForwardAnnotations(Class<?> udfClass)
Reads the annotations of a user defined function with one input and returns semantic properties according to the forwarded fields annotated.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatCommonBase<T,SPITTYPE extends InputSplit>
A common base for both "mapred" and "mapreduce" Hadoop input formats.
|
class |
HadoopOutputFormatCommonBase<T>
A common base for both "mapred" and "mapreduce" Hadoop output formats.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatBase<K,V,T>
Common base for Java and Scala API for using Hadoop input formats with Flink.
|
class |
HadoopOutputFormatBase<K,V,T>
Common base for the mapred HadoopOutputFormat wrappers.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopUtils
Utility class to work with Apache Hadoop MapRed classes.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputSplit
A wrapper that represents an input split from the Hadoop mapred API as
a Flink
InputSplit . |
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink.
|
class |
HadoopOutputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopUtils
Utility class to work with next generation of Apache Hadoop MapReduce classes.
|
Modifier and Type | Class and Description |
---|---|
class |
BlockingShuffleOutputFormat<T>
This is the inner OutputFormat used for specify the BLOCKING_PERSISTENT result partition type of coming edge.
|
class |
CsvInputFormat<OUT>
InputFormat that reads csv files.
|
class |
PojoCsvInputFormat<OUT>
Input format that reads csv into POJOs.
|
class |
TupleCsvInputFormat<OUT>
Input format that reads csv into tuples.
|
Modifier and Type | Class and Description |
---|---|
class |
BulkIterationResultSet<T>
Resulting
DataSet of bulk iterations. |
class |
CoGroupRawOperator<I1,I2,OUT>
A
DataSet that is the result of a CoGroup transformation. |
static class |
CrossOperator.CrossProjection<I1,I2> |
static class |
CrossOperator.ProjectCrossFunction<T1,T2,R extends Tuple> |
static class |
JoinOperator.DefaultJoin.WrappingFlatJoinFunction<IN1,IN2,OUT>
Wrapper around
JoinFunction . |
class |
KeyFunctions
This class holds static utilities to append functions that extract and
prune keys.
|
class |
NoOpOperator<IN>
This operator will be ignored during translation.
|
class |
OperatorTranslation
Used for translating data sets into corresponding operators.
|
static class |
ProjectOperator.Projection<T>
A projection of
DataSet . |
Modifier and Type | Method and Description |
---|---|
Map<String,DataSet<?>> |
UdfOperator.getBroadcastSets()
Gets the broadcast sets (name and data set) that have been added to context of the UDF.
|
Map<String,DataSet<?>> |
SingleInputUdfOperator.getBroadcastSets() |
Map<String,DataSet<?>> |
TwoInputUdfOperator.getBroadcastSets() |
CrossOperatorBase.CrossHint |
CrossOperator.getCrossHint() |
Partitioner<?> |
Grouping.getCustomPartitioner()
Gets the custom partitioner to be used for this grouping, or
null , if
none was defined. |
Partitioner<?> |
PartitionOperator.getCustomPartitioner()
Gets the custom partitioner from this partitioning.
|
DataSet<T> |
DataSink.getDataSet() |
OutputFormat<T> |
DataSink.getFormat() |
DataSet<T> |
Grouping.getInputDataSet()
Returns the input DataSet of a grouping operation, that is the one before the grouping.
|
InputFormat<OUT,?> |
DataSource.getInputFormat()
Gets the input format that is executed by this data source.
|
JoinOperatorBase.JoinHint |
JoinOperator.getJoinHint()
Gets the JoinHint that describes how the join is executed.
|
JoinType |
JoinOperator.getJoinType()
Gets the JoinType that describes this join operation (e.g.
|
int[] |
DeltaIterationResultSet.getKeyPositions() |
Keys<T> |
Grouping.getKeys() |
protected Keys<I1> |
CoGroupOperator.getKeys1() |
protected Keys<I2> |
CoGroupOperator.getKeys2() |
int |
DeltaIterationResultSet.getMaxIterations() |
Partitioner<?> |
JoinOperator.getPartitioner()
Gets the custom partitioner used by this join, or
null , if none is set. |
SemanticProperties |
UdfOperator.getSemanticProperties()
Gets the semantic properties that have been set for the user-defined functions (UDF).
|
SingleInputSemanticProperties |
SingleInputUdfOperator.getSemanticProperties() |
SingleInputSemanticProperties |
ReduceOperator.getSemanticProperties() |
SingleInputSemanticProperties |
GroupReduceOperator.getSemanticProperties() |
DualInputSemanticProperties |
TwoInputUdfOperator.getSemanticProperties() |
SingleInputSemanticProperties |
GroupCombineOperator.getSemanticProperties() |
DualInputSemanticProperties |
JoinOperator.EquiJoin.getSemanticProperties() |
TypeInformation<T> |
DataSink.getType() |
boolean |
GroupReduceOperator.isCombinable() |
void |
TwoInputUdfOperator.setSemanticProperties(DualInputSemanticProperties properties)
Sets the semantic properties for the user-defined function (UDF).
|
void |
SingleInputUdfOperator.setSemanticProperties(SingleInputSemanticProperties properties)
Sets the semantic properties for the user-defined function (UDF).
|
protected CoGroupOperatorBase<?,?,OUT,?> |
CoGroupOperator.translateToDataFlow(Operator<I1> input1,
Operator<I2> input2) |
protected GroupReduceOperatorBase<IN,IN,GroupReduceFunction<IN,IN>> |
AggregateOperator.translateToDataFlow(Operator<IN> input) |
Modifier and Type | Class and Description |
---|---|
class |
CombineToGroupCombineWrapper<IN,OUT,F extends CombineFunction<IN,IN> & GroupReduceFunction<IN,OUT>>
A wrapper the wraps a function that implements both
CombineFunction and GroupReduceFunction interfaces
and makes it look like a function that implements GroupCombineFunction and GroupReduceFunction to the runtime. |
class |
KeyExtractingMapper<T,K>
Mapper that extracts keys.
|
class |
KeyRemovingMapper<T,K>
Mapper that removes keys.
|
class |
PlanBothUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values.
|
class |
PlanFilterOperator<T> |
class |
PlanLeftUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values on the left.
|
class |
PlanProjectOperator<T,R extends Tuple>
A map operator that retains a subset of fields from incoming tuples.
|
class |
PlanRightUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values on the right.
|
class |
PlanUnwrappingGroupCombineOperator<IN,OUT,K>
A group combine operator that takes 2-tuples (key-value pairs), and applies the group combine operation only
on the unwrapped values.
|
class |
PlanUnwrappingReduceGroupOperator<IN,OUT,K>
A reduce operator that takes 2-tuples (key-value pairs), and applies the group reduce operation only
on the unwrapped values.
|
class |
PlanUnwrappingReduceOperator<T,K>
A reduce operator that takes 2-tuples (key-value pairs), and applies the reduce operation only
on the unwrapped values.
|
class |
PlanUnwrappingSortedGroupCombineOperator<IN,OUT,K1,K2>
A reduce operator that takes 3-tuples (groupKey, sortKey, value), and applies the sorted partial group reduce
operation only on the unwrapped values.
|
class |
PlanUnwrappingSortedReduceGroupOperator<IN,OUT,K1,K2>
A reduce operator that takes 3-tuples (groupKey, sortKey, value), and applies the sorted group reduce
operation only on the unwrapped values.
|
class |
Tuple3UnwrappingIterator<T,K1,K2>
An iterator that reads 3-tuples (groupKey, sortKey, value) and returns only the values (third field).
|
class |
Tuple3WrappingCollector<IN,K1,K2>
Needed to wrap tuples to
Tuple3<groupKey, sortKey, value> for combine method of group reduce with key selector sorting. |
class |
TupleLeftUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps values from the left set before applying the join operation.
|
class |
TupleRightUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps values from the right set before applying the join operation.
|
class |
TupleUnwrappingIterator<T,K>
An iterator that reads 2-tuples (key value pairs) and returns only the values (second field).
|
class |
TupleUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps both values before applying the join operation.
|
class |
TupleWrappingCollector<IN,K>
Needed to wrap tuples to
Tuple2<key, value> pairs for combine method of group reduce with key selector function. |
class |
TwoKeyExtractingMapper<T,K1,K2>
Mapper that extracts two keys of a value.
|
class |
WrappingFunction<T extends Function>
Wrapper around
Function . |
Modifier and Type | Class and Description |
---|---|
class |
BernoulliSampler<T>
A sampler implementation built upon a Bernoulli trail.
|
class |
DistributedRandomSampler<T>
For sampling with fraction, the sample algorithms are natively distributed, while it's not
true for fixed size sample algorithms.
|
class |
IntermediateSampleData<T>
The data structure which is transferred between partitions and the coordinator for distributed
random sampling.
|
class |
PoissonSampler<T>
A sampler implementation based on the Poisson Distribution.
|
class |
RandomSampler<T>
A data sample is a set of data selected from a statistical population by a defined procedure.
|
class |
ReservoirSamplerWithoutReplacement<T>
A simple in memory implementation of Reservoir Sampling without replacement, and with only one
pass through the input iteration whose size is unpredictable.
|
class |
ReservoirSamplerWithReplacement<T>
A simple in memory implementation of Reservoir Sampling with replacement and with only one pass
through the input iteration whose size is unpredictable.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Aggregator<T,R>
Generic interface for aggregation.
|
class |
BooleanSummaryAggregator
Aggregator for
Boolean type. |
class |
CompensatedSum
Used to calculate sums using the Kahan summation algorithm.
|
class |
DoubleSummaryAggregator
Aggregator that can handle Double types.
|
class |
FloatSummaryAggregator
Aggregator that can handle Float types.
|
class |
IntegerSummaryAggregator
Aggregator that can handle Integer types.
|
class |
LongSummaryAggregator
Aggregator that can handle Long types.
|
class |
NumericSummaryAggregator<T extends Number>
Generic aggregator for all numeric types creates a summary of a column of numbers.
|
class |
ObjectSummaryAggregator
Aggregator that calculates statistics for Object values. |
class |
ShortSummaryAggregator
Aggregator that can handle Short types.
|
class |
StringSummaryAggregator
Aggregator that calculates statistics for String values. |
class |
SummaryAggregatorFactory
Factory for creating Summary Aggregators.
|
class |
TupleSummaryAggregator<R extends Tuple>
Aggregate tuples using an array of aggregators, one for each "column" or position within the Tuple.
|
class |
ValueSummaryAggregator<VT extends Value,PT,R,A extends Aggregator<PT,R>>
This is a generic Aggregator for Value types like StringValue, DoubleValue, etc.
|
Modifier and Type | Class and Description |
---|---|
class |
PojoField
Represent a field definition for
PojoTypeInfo type of objects. |
class |
TypeExtractionException
Type extraction always contains some uncertainty due to unpredictable JVM differences
between vendors or versions.
|
class |
TypeExtractionUtils |
Modifier and Type | Method and Description |
---|---|
static <OUT> TypeInfoFactory<OUT> |
TypeExtractor.getTypeInfoFactory(Type t)
Returns the type information factory for a type using the factory registry or annotations.
|
Modifier and Type | Class and Description |
---|---|
class |
CopyableValueComparator<T extends CopyableValue<T> & Comparable<T>>
Comparator for all Value types that extend Key
|
class |
CopyableValueSerializer<T extends CopyableValue<T>> |
class |
DataInputViewStream
An input stream that draws its data from a
DataInputView . |
class |
DataOutputViewStream |
class |
EitherSerializer<L,R>
A
TypeSerializer for the Either type of the Java class. |
class |
EitherSerializerConfigSnapshot<L,R>
Deprecated.
|
class |
EitherSerializerSnapshot<L,R>
Deprecated.
this snapshot class is no longer used by any serializers.
Instead,
JavaEitherSerializerSnapshot is used. |
class |
FieldSerializer
This class is for the serialization of java.lang.reflect.Field, which doesn't implement Serializable, therefore
readObject/writeObject need to be implemented in classes where there is a field of type java.lang.reflect.Field.
|
class |
GenericTypeComparator<T extends Comparable<T>>
TypeComparator for all types that extend Comparable.
|
class |
KryoRegistration
A
KryoRegistration resembles a registered class and its serializer in Kryo. |
class |
KryoRegistrationSerializerConfigSnapshot<T>
Configuration snapshot base class for serializers that use Kryo for serialization.
|
class |
KryoUtils
Convenience methods for Kryo
|
class |
NoFetchingInput |
static class |
NullableSerializer.NullableSerializerConfigSnapshot<T>
Deprecated.
this snapshot class is no longer in use, and is maintained only for
backwards compatibility purposes. It is fully replaced
by
NullableSerializer.NullableSerializerSnapshot . |
class |
NullAwareComparator<T>
Null-aware comparator that wraps a comparator which does not support null references.
|
class |
NullMaskUtils |
class |
PojoComparator<T> |
class |
PojoSerializer<T> |
class |
PojoSerializerSnapshot<T>
Snapshot class for the
PojoSerializer . |
class |
RowComparator
Comparator for
Row |
class |
RowSerializer
Serializer for
Row . |
class |
RuntimeComparatorFactory<T> |
class |
RuntimePairComparatorFactory<T1,T2> |
class |
RuntimeSerializerFactory<T> |
class |
Tuple0Serializer |
class |
TupleComparator<T extends Tuple> |
class |
TupleComparatorBase<T> |
class |
TupleSerializer<T extends Tuple> |
class |
TupleSerializerBase<T> |
class |
TupleSerializerConfigSnapshot<T>
Snapshot of a tuple serializer's configuration.
|
class |
TupleSerializerSnapshot<T extends Tuple>
Snapshot of a tuple serializer's configuration.
|
class |
ValueComparator<T extends Value & Comparable<T>>
Comparator for all Value types that extend Key
|
class |
ValueSerializer<T extends Value>
Serializer for
Value types. |
class |
WritableSerializer<T extends org.apache.hadoop.io.Writable>
A
TypeSerializer for Writable . |
Modifier and Type | Class and Description |
---|---|
class |
Serializers
Class containing utilities for the serializers of the Flink Runtime.
|
Modifier and Type | Class and Description |
---|---|
class |
ScalaCaseClassSerializerSnapshot<T extends scala.Product>
TypeSerializerSnapshot for ScalaCaseClassSerializer . |
class |
Tuple2CaseClassSerializerSnapshot<T1,T2>
TypeSerializerSnapshot for ScalaCaseClassSerializer . |
Modifier and Type | Class and Description |
---|---|
static class |
PatternStream.CoMapTimeout<R,L>
Used for joining results from timeout side-output for API backward compatibility.
|
Modifier and Type | Class and Description |
---|---|
class |
PatternFlatSelectAdapter<IN,OUT>
Adapter that expresses
PatternFlatSelectFunction with PatternProcessFunction . |
class |
PatternSelectAdapter<IN,OUT>
Adapter that expresses
PatternSelectFunction with PatternProcessFunction . |
class |
PatternTimeoutFlatSelectAdapter<IN,OUT,T>
Adapter that expresses combination of
PatternFlatSelectFunction and PatternTimeoutFlatSelectAdapter
with PatternProcessFunction . |
class |
PatternTimeoutSelectAdapter<IN,OUT,T>
Adapter that expresses combination of
PatternSelectFunction and PatternTimeoutFlatSelectAdapter
with PatternProcessFunction . |
Modifier and Type | Class and Description |
---|---|
class |
LockableTypeSerializerSnapshot<E>
|
Modifier and Type | Class and Description |
---|---|
class |
CepOperator<IN,KEY,OUT>
CEP pattern operator for a keyed input stream.
|
Modifier and Type | Class and Description |
---|---|
class |
AndCondition<T>
Deprecated.
Please use
RichAndCondition instead. This class exists just for
backwards compatibility and will be removed in FLINK-10113. |
class |
BooleanConditions
Utility class containing an
IterativeCondition that always returns
true and one that always returns false . |
class |
NotCondition<T>
Deprecated.
Please use
RichNotCondition instead. This class exists just for
backwards compatibility and will be removed in FLINK-10113. |
class |
OrCondition<T>
Deprecated.
Please use
RichOrCondition instead. This class exists just for
backwards compatibility and will be removed in FLINK-10113. |
class |
RichAndCondition<T>
|
class |
RichNotCondition<T>
A
condition which negates the condition it wraps
and returns true if the original condition returns false . |
class |
RichOrCondition<T>
A
condition which combines two conditions with a logical
OR and returns true if at least one is true . |
class |
SimpleCondition<T>
A user-defined condition that decides if an element should be accepted in the pattern or not.
|
class |
SubtypeCondition<T>
A
condition which filters elements of the given type. |
Modifier and Type | Interface and Description |
---|---|
interface |
TimerService
Enables to provide time characteristic to
NFA for use in
IterativeCondition . |
Modifier and Type | Class and Description |
---|---|
class |
GlobalConfiguration
Global configuration object for Flink.
|
class |
RestOptions
Configuration parameters for REST communication.
|
Modifier and Type | Class and Description |
---|---|
class |
RocksDBNativeMetricMonitor
A monitor which pulls {
RocksDB } native metrics
and forwards them to Flink's metric group. |
class |
RocksDBProperty
RocksDB properties that can be queried by Flink's metrics reporter. |
Modifier and Type | Class and Description |
---|---|
class |
CloseableRegistry
This class allows to register instances of
Closeable , which are all closed if this registry is closed. |
class |
ClosingFSDataInputStream
This class is a
WrappingProxy for FSDataInputStream that is used to
implement a safety net against unclosed streams. |
class |
ClosingFSDataOutputStream
This class is a
WrappingProxy for FSDataOutputStream that is used to
implement a safety net against unclosed streams. |
class |
ConnectionLimitingFactory
A wrapping factory that adds a
LimitedConnectionsFileSystem to a file system. |
class |
FileSystemSafetyNet
The FileSystemSafetyNet can be used to guard a thread against
FileSystem stream resource leaks. |
class |
FSDataInputStreamWrapper
Simple forwarding wrapper around
FSDataInputStream . |
class |
FSDataOutputStreamWrapper
Simple forwarding wrapper around
FSDataInputStream . |
class |
LimitedConnectionsFileSystem
A file system that limits the number of concurrently open input streams,
output streams, and total streams for a target file system.
|
class |
SafetyNetCloseableRegistry
This implementation of an
AbstractCloseableRegistry registers WrappingProxyCloseable . |
class |
SafetyNetWrapperFileSystem
This is a
WrappingProxy around FileSystem which (i) wraps all opened streams as
ClosingFSDataInputStream or ClosingFSDataOutputStream and (ii) registers them to
a SafetyNetCloseableRegistry . |
interface |
WrappingProxyCloseable<T extends Closeable>
WrappingProxy for Closeable that is also closeable. |
Modifier and Type | Method and Description |
---|---|
static void |
FileSystemSafetyNet.closeSafetyNetAndGuardedResourcesForThread()
Closes the safety net for a thread.
|
static SafetyNetCloseableRegistry |
FileSystemSafetyNet.getSafetyNetCloseableRegistryForThread()
Deprecated.
This method should be removed after FLINK-6684 is implemented.
|
static FileSystem |
FileSystem.getUnguardedFileSystem(URI fsUri) |
static void |
FileSystemSafetyNet.initializeSafetyNetForThread()
Activates the safety net for a thread.
|
static void |
FileSystemSafetyNet.setSafetyNetCloseableRegistryForThread(SafetyNetCloseableRegistry registry)
Sets the active safety-net registry for the current thread.
|
Modifier and Type | Class and Description |
---|---|
class |
LocalBlockLocation
Implementation of the
BlockLocation interface for a local file system. |
class |
LocalDataInputStream
The
LocalDataInputStream class is a wrapper class for a data
input stream to the local file system. |
class |
LocalDataOutputStream
The
LocalDataOutputStream class is a wrapper class for a data
output stream to the local file system. |
class |
LocalFileStatus
The class
LocalFileStatus provides an implementation of the FileStatus interface
for the local file system. |
class |
LocalFileSystem
The class
LocalFileSystem is an implementation of the FileSystem interface
for the local file system of the machine where the JVM runs. |
class |
LocalRecoverableWriter
A
RecoverableWriter for the LocalFileSystem . |
Modifier and Type | Class and Description |
---|---|
class |
PostVersionedIOReadableWritable
A
VersionedIOReadableWritable which allows to differentiate whether the previous
data was versioned with a VersionedIOReadableWritable . |
interface |
SimpleVersionedSerializer<E>
A simple serializer interface for versioned serialization.
|
class |
VersionedIOReadableWritable
This is the abstract base class for
IOReadableWritable which allows to differentiate between serialization
versions. |
Modifier and Type | Class and Description |
---|---|
class |
ByteArrayInputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayInputStream that also exposes the current position.
|
class |
ByteArrayOutputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayOutputStream that also exposes the current position.
|
class |
HeapMemorySegment
This class represents a piece of heap memory managed by Flink.
|
class |
HybridMemorySegment
This class represents a piece of memory managed by Flink.
|
class |
MemorySegment
This class represents a piece of memory managed by Flink.
|
class |
MemorySegmentFactory
A factory for (hybrid) memory segments (
HybridMemorySegment ). |
interface |
MemorySegmentSource
Interface describing entities that can provide memory segments.
|
interface |
MemorySegmentWritable
Provides the interface for write(Segment).
|
class |
MemoryType
The class of memory, such as heap or off-heap.
|
class |
MemoryUtils
Utility class for memory operations.
|
Modifier and Type | Class and Description |
---|---|
class |
PluginManager
Manager class and entry-point for the plugin mechanism in Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
BackPressuringExecutor
An executor decorator that allows only a certain number of concurrent executions.
|
class |
OffsetAwareOutputStream
An
OutputStream that keeps track of its current length. |
interface |
RefCounted
Interface to simply add reference counting functionality.
|
class |
RefCountedBufferingFileStream
A
RefCountedFile that also uses an in-memory buffer for buffering small writes. |
class |
RefCountedFile
A reference counted file which is deleted as soon as no caller
holds a reference to the wrapped
File . |
class |
RefCountedFSOutputStream
A
FSDataOutputStream with the RefCounted functionality. |
class |
RefCountedTmpFileCreator
A utility class that creates local
reference counted files that serve as temporary files. |
Modifier and Type | Interface and Description |
---|---|
interface |
S3AccessHelper
An interface that abstracts away the Multi-Part Upload (MPU) functionality offered by S3,
from the specific implementation of the file system.
|
Modifier and Type | Class and Description |
---|---|
class |
ByteValueArrayComparator
Specialized comparator for ByteValueArray based on CopyableValueComparator.
|
class |
CharValueArrayComparator
Specialized comparator for CharValueArray based on CopyableValueComparator.
|
class |
DoubleValueArrayComparator
Specialized comparator for DoubleValueArray based on CopyableValueComparator.
|
class |
FloatValueArrayComparator
Specialized comparator for FloatValueArray based on CopyableValueComparator.
|
class |
IntValueArrayComparator
Specialized comparator for IntValueArray based on CopyableValueComparator.
|
class |
LongValueArrayComparator
Specialized comparator for LongValueArray based on CopyableValueComparator.
|
class |
NullValueArrayComparator
Specialized comparator for NullValueArray based on CopyableValueComparator.
|
class |
ShortValueArrayComparator
Specialized comparator for ShortValueArray based on CopyableValueComparator.
|
class |
StringValueArrayComparator
Specialized comparator for StringValueArray based on CopyableValueComparator.
|
Modifier and Type | Class and Description |
---|---|
class |
VoidNamespace
Singleton placeholder class for state without a namespace.
|
class |
VoidNamespaceSerializer
Serializer for
VoidNamespace . |
class |
VoidNamespaceTypeInfo
|
Modifier and Type | Class and Description |
---|---|
class |
KvStateClientProxyHandler
This handler acts as an internal (to the Flink cluster) client that receives
the requests from external clients, executes them by contacting the Job Manager (if necessary) and
the Task Manager holding the requested state, and forwards the answer back to the client.
|
class |
KvStateClientProxyImpl
The default implementation of the
KvStateClientProxy . |
Modifier and Type | Class and Description |
---|---|
class |
UnknownKeyOrNamespaceException
Thrown if the KvState does not hold any state for the given key or namespace.
|
class |
UnknownKvStateIdException
Thrown if no KvState with the given ID cannot found by the server handler.
|
class |
UnknownKvStateKeyGroupLocationException
Exception thrown if there is no location information available for the given key group.
|
class |
UnknownLocationException
Exception to fail Future if the Task Manager on which the
Client Proxy is running on, does not know the location
of a requested state. |
Modifier and Type | Class and Description |
---|---|
class |
KvStateInternalRequest
The request to be forwarded by the
Queryable State Client Proxy to the State Server
of the Task Manager responsible for the requested state. |
class |
KvStateRequest
The request to be sent by the
Queryable State Client to the Client Proxy requesting a given state. |
class |
KvStateResponse
The response containing the (serialized) state sent by the
State Server to the Client Proxy ,
and then forwarded by the proxy to the original
Queryable State Client . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractServerBase<REQ extends MessageBody,RESP extends MessageBody>
The base class for every server in the queryable state module.
|
class |
AbstractServerHandler<REQ extends MessageBody,RESP extends MessageBody>
The base class of every handler used by an
AbstractServerBase . |
class |
BadRequestException
Base class for exceptions thrown during querying Flink's managed state.
|
class |
ChunkedByteBuf
A
ByteBuf instance to be consumed in chunks by ChunkedWriteHandler ,
respecting the high and low watermarks. |
class |
Client<REQ extends MessageBody,RESP extends MessageBody>
The base class for every client in the queryable state module.
|
class |
ClientHandler<REQ extends MessageBody,RESP extends MessageBody>
The handler used by a
Client to handling incoming messages. |
interface |
ClientHandlerCallback<RESP extends MessageBody>
Callback for
ClientHandler . |
Modifier and Type | Class and Description |
---|---|
class |
MessageBody
|
interface |
MessageDeserializer<M extends MessageBody>
A utility used to deserialize a
message . |
class |
MessageSerializer<REQ extends MessageBody,RESP extends MessageBody>
|
class |
MessageType
|
class |
RequestFailure
A message indicating a protocol-related error.
|
Modifier and Type | Class and Description |
---|---|
class |
KvStateServerHandler
This handler dispatches asynchronous tasks, which query
InternalKvState
instances and write the result to the channel. |
class |
KvStateServerImpl
The default implementation of the
KvStateServer . |
Modifier and Type | Class and Description |
---|---|
class |
CheckpointRetentionPolicy
Policy for whether checkpoints are retained after a job terminates.
|
interface |
OperatorStateRepartitioner
Interface that allows to implement different strategies for repartitioning of operator state as parallelism changes.
|
class |
PrioritizedOperatorSubtaskState
This class is a wrapper over multiple alternative
OperatorSubtaskState that are (partial) substitutes for
each other and imposes a priority ordering over all alternatives for the different states which define an order in
which the operator should attempt to restore the state from them. |
static class |
PrioritizedOperatorSubtaskState.Builder |
class |
RoundRobinOperatorStateRepartitioner
Current default implementation of
OperatorStateRepartitioner that redistributes state in round robin fashion. |
class |
StateAssignmentOperation
This class encapsulates the operation of assigning restored state when restoring from a checkpoint.
|
Modifier and Type | Class and Description |
---|---|
class |
SavepointV1Serializer
Deserializer for checkpoints written in format
1 (Flink 1.2.x format) |
class |
SavepointV2Serializer
(De)serializer for checkpoint metadata format version 2.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopRecoverableWriter
An implementation of the
RecoverableWriter for
Hadoop's file system abstraction. |
Modifier and Type | Interface and Description |
---|---|
interface |
AsyncDataInput<T>
Interface defining couple of essential methods for asynchronous and non blocking data polling.
|
interface |
AvailabilityListener
Interface defining couple of essential methods for listening on data availability using
CompletableFuture . |
interface |
NullableAsyncDataInput<T>
The variant of
AsyncDataInput that for performance reasons returns null from
NullableAsyncDataInput.pollNextNullable() instead returning Optional.empty() from
AsyncDataInput.pollNext() . |
Modifier and Type | Class and Description |
---|---|
static class |
JobResult.Builder
Builder for
JobResult . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractMetricGroup<A extends AbstractMetricGroup<?>>
Abstract
MetricGroup that contains key functionality for adding metrics and groups. |
class |
ComponentMetricGroup<P extends AbstractMetricGroup<?>>
Abstract
MetricGroup for system components (e.g.,
TaskManager, Job, Task, Operator). |
class |
GenericKeyMetricGroup
A
GenericMetricGroup for representing the key part of a key-value metric group pair. |
class |
GenericMetricGroup
A simple named
MetricGroup that is used to hold
subgroups of metrics. |
class |
GenericValueMetricGroup
A
GenericMetricGroup for representing the value part of a key-value metric group pair. |
class |
JobManagerJobMetricGroup
Special
MetricGroup representing everything belonging to
a specific job, running on the JobManager. |
class |
JobMetricGroup<C extends ComponentMetricGroup<C>>
Special abstract
MetricGroup representing everything belonging to
a specific job. |
class |
OperatorMetricGroup
Special
MetricGroup representing an Operator. |
class |
TaskManagerJobMetricGroup
Special
MetricGroup representing everything belonging to
a specific job, running on the TaskManager. |
class |
TaskManagerMetricGroup
Special
MetricGroup representing a TaskManager. |
class |
TaskMetricGroup
Special
MetricGroup representing a Flink runtime Task. |
Modifier and Type | Class and Description |
---|---|
class |
KvStateEntry<K,N,V>
An entry holding the
InternalKvState along with its KvStateInfo . |
Modifier and Type | Class and Description |
---|---|
class |
KerberosUtils
Provides vendor-specific Kerberos
AppConfigurationEntry instances. |
Modifier and Type | Class and Description |
---|---|
class |
JaasModule
Responsible for installing a process-wide JAAS configuration.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ConfigurableStateBackend
An interface for state backends that pick up additional parameters from a configuration.
|
class |
DefaultOperatorStateBackend
Default implementation of OperatorStateStore that provides the ability to make snapshots.
|
interface |
InternalPriorityQueue<T>
Interface for collection that gives in order access to elements w.r.t their priority.
|
interface |
OwnedTaskLocalStateStore
This interface represents the administrative interface to
TaskLocalStateStore , that only the owner of the
object should see. |
class |
SnappyStreamCompressionDecorator
This implementation decorates the stream with snappy compression.
|
interface |
SnapshotStrategy<S extends StateObject>
Interface for different snapshot approaches in state backends.
|
class |
StateSerializerProvider<T>
A
StateSerializerProvider wraps logic on how to obtain serializers for registered state,
either with the previous schema of state in checkpoints or the current schema of state. |
interface |
StateSnapshot
General interface for state snapshots that should be written partitioned by key-groups.
|
interface |
StateSnapshotKeyGroupReader
Interface for state de-serialization into
StateTable s by key-group. |
interface |
StateSnapshotRestore
Interface to deal with state snapshot and restore of state.
|
interface |
StateTransformationFunction<S,T>
Interface for a binary function that is used for push-down of state transformation into state backends.
|
class |
StreamCompressionDecorator
Implementations of this interface decorate streams with a compression scheme.
|
interface |
TaskLocalStateStore
Classes that implement this interface serve as a task-manager-level local storage for local checkpointed state.
|
class |
UncompressedStreamCompressionDecorator
This implementation does not decorate the stream with any compression.
|
Modifier and Type | Method and Description |
---|---|
static CompletedCheckpointStorageLocation |
AbstractFsCheckpointStorage.resolveCheckpointPointer(String checkpointPointer)
Takes the given string (representing a pointer to a checkpoint) and resolves it to a file
status for the checkpoint's metadata file.
|
Modifier and Type | Class and Description |
---|---|
class |
CopyOnWriteStateTableSnapshot<K,N,S>
This class represents the snapshot of a
CopyOnWriteStateTable and has a role in operator state checkpointing. |
interface |
HeapPriorityQueueElement
Interface for objects that can be managed by a
HeapPriorityQueue . |
interface |
InternalKeyContext<K>
This interface is the current context of a keyed state.
|
class |
NestedMapsStateTable<K,N,S>
This implementation of
StateTable uses NestedStateMap . |
Modifier and Type | Class and Description |
---|---|
class |
ForwardingInputStream
Input stream, that wraps another input stream and forwards all method calls to the wrapped stream.
|
class |
ForwardingOutputStream
Output stream, that wraps another input stream and forwards all method calls to the wrapped stream.
|
class |
NonClosingInputStreamDecorator
Decorator for input streams that ignores calls to
InputStream.close() . |
class |
NonClosingOutpusStreamDecorator
Decorator for input streams that ignores calls to
OutputStream.close() . |
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateInputFormat<K,V>
The input format for reading
BroadcastState . |
class |
KeyedStateInputFormat<K,OUT>
Input format for reading partitioned state.
|
class |
ListStateInputFormat<OT>
Input format for reading operator list state.
|
class |
UnionStateInputFormat<OT>
Input format for reading operator union state.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyGroupRangeInputSplit
An input split representing a key-group range from a savepoint.
|
class |
OperatorStateInputSplit
An input split containing state handles for operator state.
|
Modifier and Type | Class and Description |
---|---|
class |
BoundedOneInputStreamTaskRunner<IN>
A
RichMapPartitionFunction that serves as the runtime for a BoundedStreamTask . |
class |
MergeOperatorStates
A reducer that aggregates multiple
OperatorState 's into a single Savepoint . |
class |
OperatorSubtaskStateReducer
A reducer that aggregates all
OperatorSubtaskState 's for a particular operator into a
single OperatorState . |
class |
SavepointOutputFormat
An output format to serialize
Savepoint metadata to distributed storage. |
class |
SnapshotUtils
Takes a final snapshot of the state of an operator subtask.
|
class |
TaggedOperatorSubtaskState
A simple wrapper pojo that tags
OperatorSubtaskState with metadata. |
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateBootstrapOperator<IN>
A
StreamOperator for executing BroadcastStateBootstrapFunction 's. |
class |
KeyedStateBootstrapOperator<K,IN>
A
StreamOperator for executing KeyedStateBootstrapFunction 's. |
class |
StateBootstrapOperator<IN>
A
StreamOperator for executing StateBootstrapFunction 's. |
Modifier and Type | Class and Description |
---|---|
class |
HashSelector<IN>
A wrapper around a
KeySelector that returns the Object.hashCode() of the returned
key. |
class |
KeyGroupRangePartitioner
A partitioner that selects the target channel based on the key group index.
|
Modifier and Type | Class and Description |
---|---|
class |
BootstrapTransformationWithID<T>
A simple container class that represents a newly bootstrapped operator state within savepoints.
|
class |
BoundedStreamConfig
A
StreamConfig with default settings. |
class |
NeverFireProcessingTimeService
A processing time service whose timers never fire so all timers are included in savepoints.
|
class |
OperatorIDGenerator
Utility for generating Operator Id's from uid strings.
|
class |
SavepointEnvironment
A minimally implemented
Environment that provides the functionality required to run the
state-processor-api . |
class |
SavepointLoader
Utility class for loading
Savepoint metadata. |
class |
SavepointRuntimeContext
A streaming
RuntimeContext which delegates to the underlying batch RuntimeContext
along with a specified KeyedStateStore . |
class |
VoidTriggerable<K,N>
A
Triggerable that does nothing. |
Modifier and Type | Class and Description |
---|---|
class |
SavepointMetadata
Savepoint metadata that can be modified.
|
Modifier and Type | Class and Description |
---|---|
class |
SimpleTimerService
Implementation of
TimerService that uses a InternalTimerService . |
Modifier and Type | Class and Description |
---|---|
static class |
CoGroupedStreams.TaggedUnion<T1,T2>
Internal class for implementing tagged union co-group.
|
Modifier and Type | Method and Description |
---|---|
<R,ACC> SingleOutputStreamOperator<R> |
WindowedStream.fold(ACC initialValue,
FoldFunction<T,ACC> foldFunction,
ProcessWindowFunction<ACC,R,K,W> windowFunction,
TypeInformation<ACC> foldResultType,
TypeInformation<R> windowResultType)
Deprecated.
|
int |
DataStream.getId()
Returns the ID of the
DataStream in the current StreamExecutionEnvironment . |
KeySelector<T,KEY> |
KeyedStream.getKeySelector()
Gets the key selector that can get the key by which the stream if partitioned from the elements.
|
TypeInformation<KEY> |
KeyedStream.getKeyType()
Gets the type of the key by which the stream is partitioned.
|
Transformation<T> |
DataStream.getTransformation()
Returns the
Transformation that represents the operation that logically creates
this DataStream . |
SinkTransformation<T> |
DataStreamSink.getTransformation()
Returns the transformation that contains the actual sink operator of this sink.
|
<R> SingleOutputStreamOperator<R> |
ConnectedStreams.process(CoProcessFunction<IN1,IN2,R> coProcessFunction,
TypeInformation<R> outputType)
Applies the given
CoProcessFunction on the connected input streams,
thereby creating a transformed output stream. |
<K,R> SingleOutputStreamOperator<R> |
ConnectedStreams.process(KeyedCoProcessFunction<K,IN1,IN2,R> keyedCoProcessFunction,
TypeInformation<R> outputType)
Applies the given
KeyedCoProcessFunction on the connected input streams,
thereby creating a transformed output stream. |
<R> SingleOutputStreamOperator<R> |
KeyedStream.process(KeyedProcessFunction<KEY,T,R> keyedProcessFunction,
TypeInformation<R> outputType)
Applies the given
KeyedProcessFunction on the input stream, thereby creating a transformed output stream. |
<R> SingleOutputStreamOperator<R> |
DataStream.process(ProcessFunction<T,R> processFunction,
TypeInformation<R> outputType)
Applies the given
ProcessFunction on the input stream, thereby
creating a transformed output stream. |
<R> SingleOutputStreamOperator<R> |
KeyedStream.process(ProcessFunction<T,R> processFunction,
TypeInformation<R> outputType)
Deprecated.
|
<R> SingleOutputStreamOperator<R> |
WindowedStream.process(ProcessWindowFunction<T,R,K,W> function,
TypeInformation<R> resultType)
Applies the given window function to each window.
|
<R> SingleOutputStreamOperator<R> |
WindowedStream.reduce(ReduceFunction<T> reduceFunction,
ProcessWindowFunction<T,R,K,W> function,
TypeInformation<R> resultType)
Applies the given window function to each window.
|
Modifier and Type | Method and Description |
---|---|
void |
StreamExecutionEnvironment.addOperator(Transformation<?> transformation)
Adds an operator to the list of operators that should be executed when calling
StreamExecutionEnvironment.execute() . |
<F> F |
StreamExecutionEnvironment.clean(F f)
Returns a "closure-cleaned" version of the given function.
|
abstract JobExecutionResult |
StreamExecutionEnvironment.execute(StreamGraph streamGraph)
Triggers the program execution.
|
StreamGraph |
StreamExecutionEnvironment.getStreamGraph()
Getter of the
StreamGraph of the streaming job. |
StreamGraph |
StreamExecutionEnvironment.getStreamGraph(String jobName)
Getter of the
StreamGraph of the streaming job. |
Modifier and Type | Class and Description |
---|---|
class |
AggregationFunction<T>
Holder class for aggregation types that can be used on a windowed stream or keyed stream.
|
class |
ComparableAggregator<T>
An
AggregationFunction that computes values based on comparisons of
Comparables . |
class |
Comparator
Internal comparator implementation, for use with
ComparableAggregator . |
class |
SumAggregator<T>
An
AggregationFunction that sums up fields. |
class |
SumFunction
Internal function for summing up contents of fields.
|
Modifier and Type | Class and Description |
---|---|
class |
QueryableAppendingStateOperator<IN>
Internal operator handling queryable AppendingState instances.
|
class |
QueryableValueStateOperator<IN>
Internal operator handling queryable ValueState instances.
|
Modifier and Type | Class and Description |
---|---|
class |
SinkContextUtil
Utility for creating Sink
Contexts . |
static class |
TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>
State POJO class coupling pendingTransaction, context and pendingCommitTransactions.
|
static class |
TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>
Custom
TypeSerializer for the sink state. |
static class |
TwoPhaseCommitSinkFunction.StateSerializerConfigSnapshot<TXN,CONTEXT>
Deprecated.
this snapshot class is no longer in use, and is maintained only
for backwards compatibility purposes. It is fully replaced by
TwoPhaseCommitSinkFunction.StateSerializerSnapshot . |
static class |
TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>
Snapshot for the
TwoPhaseCommitSinkFunction.StateSerializer . |
static class |
TwoPhaseCommitSinkFunction.TransactionHolder<TXN>
Adds metadata (currently only the start time of the transaction) to the transaction object.
|
Modifier and Type | Class and Description |
---|---|
class |
Bucket<IN,BucketID>
A bucket is the directory organization of the output of the
StreamingFileSink . |
class |
Buckets<IN,BucketID>
The manager of the different active buckets in the
StreamingFileSink . |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileMonitoringFunction<OUT>
This is the single (non-parallel) monitoring task which takes a
FileInputFormat
and, depending on the FileProcessingMode and the FilePathFilter , it is responsible for:
Monitoring a user-provided path.
Deciding which files should be further read and processed.
Creating the splits corresponding to those files.
Assigning them to downstream tasks for further processing.
|
class |
ContinuousFileReaderOperator<OUT>
The operator that reads the
splits received from the preceding
ContinuousFileMonitoringFunction . |
class |
FileMonitoringFunction
Deprecated.
Internal class deprecated in favour of
ContinuousFileMonitoringFunction . |
class |
FileReadFunction
Deprecated.
Internal class deprecated in favour of
ContinuousFileMonitoringFunction . |
class |
InputFormatSourceFunction<OUT>
A
SourceFunction that reads data using an InputFormat . |
Modifier and Type | Class and Description |
---|---|
class |
AggregateApplyAllWindowFunction<W extends Window,T,ACC,V,R>
|
class |
AggregateApplyWindowFunction<K,W extends Window,T,ACC,V,R>
|
class |
FoldApplyAllWindowFunction<W extends Window,T,ACC,R>
Deprecated.
will be removed in a future version
|
class |
FoldApplyProcessAllWindowFunction<W extends Window,T,ACC,R>
Deprecated.
will be removed in a future version
|
class |
FoldApplyProcessWindowFunction<K,W extends Window,T,ACC,R>
Deprecated.
will be removed in a future version
|
class |
FoldApplyWindowFunction<K,W extends Window,T,ACC,R>
Deprecated.
will be removed in a future version
|
class |
InternalProcessApplyAllWindowContext<IN,OUT,W extends Window>
Internal reusable context wrapper.
|
class |
InternalProcessApplyWindowContext<IN,OUT,KEY,W extends Window>
Internal reusable context wrapper.
|
class |
PassThroughAllWindowFunction<W extends Window,T>
A
AllWindowFunction that just emits each input element. |
class |
PassThroughWindowFunction<K,W extends Window,T>
A
WindowFunction that just emits each input element. |
class |
ReduceApplyAllWindowFunction<W extends Window,T,R>
Internal
AllWindowFunction that is used for implementing a fold on a window configuration
that only allows AllWindowFunction and cannot directly execute a ReduceFunction . |
class |
ReduceApplyProcessAllWindowFunction<W extends Window,T,R>
Internal
ProcessAllWindowFunction that is used for implementing a fold on a window
configuration that only allows AllWindowFunction and cannot directly execute a
ReduceFunction . |
class |
ReduceApplyProcessWindowFunction<K,W extends Window,T,R>
Internal
ProcessWindowFunction that is used for implementing a fold on a window
configuration that only allows AllWindowFunction and cannot directly execute a
ReduceFunction . |
class |
ReduceApplyWindowFunction<K,W extends Window,T,R>
Internal
WindowFunction that is used for implementing a fold on a window configuration
that only allows WindowFunction and cannot directly execute a ReduceFunction . |
Modifier and Type | Class and Description |
---|---|
class |
ArrayFromTuple
Converts a Tuple to an Object-Array.
|
class |
ConcatenatedExtract<FROM,OVER,TO>
Combines two extractors which will be executed one after each other.
|
interface |
Extractor<FROM,TO>
Extractors allow to extract/convert one type to another.
|
class |
FieldFromArray<OUT>
Extracts a single field out of an array.
|
class |
FieldFromTuple<OUT>
Extracts a single field out of a tuple.
|
class |
FieldsFromArray<OUT>
Extracts multiple fields from an array and puts them into a new array of the
specified type.
|
class |
FieldsFromTuple
Extracts one or more fields of the type Double from a tuple and puts them into a new double[].
|
Modifier and Type | Class and Description |
---|---|
class |
JSONGenerator
Helper class for generating a JSON representation from a
StreamGraph . |
class |
StreamConfig
Internal configuration for a
StreamOperator . |
class |
StreamEdge
An edge in the streaming topology.
|
class |
StreamGraph
Class representing the streaming topology.
|
class |
StreamGraphGenerator
A generator that generates a
StreamGraph from a graph of
Transformation s. |
class |
StreamingJobGraphGenerator
The StreamingJobGraphGenerator converts a
StreamGraph into a JobGraph . |
class |
StreamNode
Class representing the operators in the streaming programs, with all their properties.
|
Modifier and Type | Interface and Description |
---|---|
interface |
InputFormatOperatorFactory<OUT>
Input format source operator factory.
|
interface |
InternalTimer<K,N>
Internal interface for in-flight timers.
|
interface |
InternalTimerService<N>
Interface for working with time and timers.
|
class |
InternalTimerServiceSerializationProxy<K>
Serialization proxy for the timer services for a given key-group.
|
class |
InternalTimersSnapshotReaderWriters
Readers and writers for different versions of the
InternalTimersSnapshot . |
class |
InternalTimeServiceManager<K>
An entity keeping all the time-related services available to all operators extending the
AbstractStreamOperator . |
class |
KeyedProcessOperator<K,IN,OUT>
A
StreamOperator for executing KeyedProcessFunctions . |
class |
LegacyKeyedProcessOperator<K,IN,OUT>
Deprecated.
Replaced by
KeyedProcessOperator which takes KeyedProcessFunction |
interface |
OnWatermarkCallback<KEY>
A callback registered with the
InternalWatermarkCallbackService service. |
interface |
OutputFormatOperatorFactory<IN>
Interface for operator factories which create the sink operator containing an
OutputFormat . |
class |
ProcessOperator<IN,OUT>
A
StreamOperator for executing
ProcessFunctions . |
class |
SimpleInputFormatOperatorFactory<OUT>
Input format source operator factory which just wrap existed
StreamSource . |
class |
SimpleOperatorFactory<OUT>
Simple factory which just wrap existed
StreamOperator . |
class |
SimpleOutputFormatOperatorFactory<IN>
A simple operator factory which create
StreamSink containing an OutputFormat . |
class |
SimpleUdfStreamOperatorFactory<OUT>
Udf stream operator factory which just wrap existed
AbstractUdfStreamOperator . |
class |
StreamFilter<IN>
A
StreamOperator for executing FilterFunctions . |
class |
StreamFlatMap<IN,OUT>
A
StreamOperator for executing FlatMapFunctions . |
class |
StreamGroupedFold<IN,OUT,KEY>
Deprecated.
will be removed in a future version
|
class |
StreamGroupedReduce<IN>
|
class |
StreamingRuntimeContext
Implementation of the
RuntimeContext ,
for streaming operators. |
class |
StreamMap<IN,OUT>
A
StreamOperator for executing MapFunctions . |
interface |
StreamOperatorFactory<OUT>
A factory to create
StreamOperator . |
class |
StreamProject<IN,OUT extends Tuple>
A
StreamOperator for executing projections on streams. |
class |
StreamSink<IN>
A
StreamOperator for executing SinkFunctions . |
class |
StreamSource<OUT,SRC extends SourceFunction<OUT>>
StreamOperator for streaming sources. |
class |
TimerHeapInternalTimer<K,N>
Implementation of
InternalTimer to use with a HeapPriorityQueueSet . |
class |
TimerSerializer<K,N>
A serializer for
TimerHeapInternalTimer objects that produces a serialization format that is
lexicographically aligned the priority of the timers. |
class |
TimerSerializerSnapshot<K,N>
Snapshot class for the
TimerSerializer . |
class |
TimestampedCollector<T>
|
interface |
Triggerable<K,N>
Interface for things that can be called by
InternalTimerService . |
interface |
UdfStreamOperatorFactory<OUT>
Udf stream operator factory.
|
Modifier and Type | Class and Description |
---|---|
class |
AsyncWaitOperator<IN,OUT>
The
AsyncWaitOperator allows to asynchronously process incoming stream records. |
class |
Emitter<OUT>
Runnable responsible for consuming elements from the given queue and outputting them to the
given output/timestampedCollector.
|
interface |
OperatorActions
Interface for
StreamOperator actions. |
Modifier and Type | Interface and Description |
---|---|
interface |
AsyncCollectionResult<T>
AsyncResult sub class for asynchronous result collections. |
interface |
AsyncResult
Asynchronous result returned by the
StreamElementQueue . |
interface |
AsyncWatermarkResult
AsyncResult subclass for asynchronous result Watermark . |
class |
OrderedStreamElementQueue
Ordered
StreamElementQueue implementation. |
interface |
StreamElementQueue
Interface for blocking stream element queues for the
AsyncWaitOperator . |
class |
StreamElementQueueEntry<T>
Entry class for the
StreamElementQueue . |
class |
StreamRecordQueueEntry<OUT>
StreamElementQueueEntry implementation for StreamRecord . |
class |
UnorderedStreamElementQueue
Unordered implementation of the
StreamElementQueue . |
class |
WatermarkQueueEntry
StreamElementQueueEntry implementation for the Watermark . |
Modifier and Type | Class and Description |
---|---|
class |
CoBroadcastWithKeyedOperator<KS,IN1,IN2,OUT>
A
TwoInputStreamOperator for executing KeyedBroadcastProcessFunctions . |
class |
CoBroadcastWithNonKeyedOperator<IN1,IN2,OUT>
A
TwoInputStreamOperator for executing BroadcastProcessFunctions . |
class |
CoProcessOperator<IN1,IN2,OUT>
A
StreamOperator for executing
CoProcessFunctions . |
class |
CoStreamFlatMap<IN1,IN2,OUT>
StreamOperator for processing
CoFlatMapFunctions . |
class |
CoStreamMap<IN1,IN2,OUT>
StreamOperator for processing
CoMapFunctions . |
class |
IntervalJoinOperator<K,T1,T2,OUT>
An
operator to execute time-bounded stream inner joins. |
class |
KeyedCoProcessOperator<K,IN1,IN2,OUT>
A
StreamOperator for executing keyed
KeyedCoProcessFunction . |
class |
LegacyKeyedCoProcessOperator<K,IN1,IN2,OUT>
Deprecated.
Replaced by
KeyedCoProcessOperator which takes KeyedCoProcessFunction |
Modifier and Type | Class and Description |
---|---|
class |
CoFeedbackTransformation<F>
This represents a feedback point in a topology.
|
class |
FeedbackTransformation<T>
This represents a feedback point in a topology.
|
class |
OneInputTransformation<IN,OUT>
This Transformation represents the application of a
OneInputStreamOperator to one input
Transformation . |
class |
PartitionTransformation<T>
This transformation represents a change of partitioning of the input elements.
|
class |
PhysicalTransformation<T>
A
Transformation that creates a physical operation. |
class |
SelectTransformation<T>
This transformation represents a selection of only certain upstream elements.
|
class |
SinkTransformation<T>
This Transformation represents a Sink.
|
class |
SourceTransformation<T>
This represents a Source.
|
class |
SplitTransformation<T>
This transformation represents a split of one
DataStream into several DataStreams
using an OutputSelector . |
class |
TwoInputTransformation<IN1,IN2,OUT>
This Transformation represents the application of a
TwoInputStreamOperator to two input Transformations . |
class |
UnionTransformation<T>
This transformation represents a union of several input
Transformations . |
Modifier and Type | Class and Description |
---|---|
static class |
GlobalWindows.NeverTrigger
A trigger that never fires, as default Trigger for GlobalWindows.
|
Modifier and Type | Class and Description |
---|---|
class |
NoOpCassandraFailureHandler
A
CassandraFailureHandler that simply fails the sink on any failures. |
Modifier and Type | Interface and Description |
---|---|
interface |
ElasticsearchApiCallBridge<C extends AutoCloseable>
An
ElasticsearchApiCallBridge is used to bridge incompatible Elasticsearch Java API calls across different versions. |
class |
ElasticsearchSinkBase<T,C extends AutoCloseable>
Base class for all Flink Elasticsearch Sinks.
|
class |
ElasticsearchUpsertTableSinkBase
A version-agnostic Elasticsearch
UpsertStreamTableSink . |
class |
ElasticsearchUpsertTableSinkFactoryBase
Version-agnostic table factory for creating an
UpsertStreamTableSink for Elasticsearch. |
Modifier and Type | Class and Description |
---|---|
class |
ElasticsearchUtils
Suite of utility methods for Elasticsearch.
|
class |
IgnoringFailureHandler
Ignores all kinds of failures and drops the affected
ActionRequest . |
class |
NoOpFailureHandler
An
ActionRequestFailureHandler that simply fails the sink on any failures. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch2ApiCallBridge
Implementation of
ElasticsearchApiCallBridge for Elasticsearch 2.x. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch5ApiCallBridge
Implementation of
ElasticsearchApiCallBridge for Elasticsearch 5.x. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch6ApiCallBridge
Implementation of
ElasticsearchApiCallBridge for Elasticsearch 6 and later versions. |
class |
Elasticsearch6UpsertTableSink
Version-specific upsert table sink for Elasticsearch 6.
|
class |
Elasticsearch6UpsertTableSinkFactory
Table factory for creating an
UpsertStreamTableSink for Elasticsearch 6. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaConsumerBase<T>
Base class of all Flink Kafka Consumer data sources.
|
static class |
FlinkKafkaProducer.ContextStateSerializer
|
static class |
FlinkKafkaProducer.KafkaTransactionContext
Context associated to this instance of the
FlinkKafkaProducer . |
static class |
FlinkKafkaProducer.NextTransactionalIdHintSerializer
|
static class |
FlinkKafkaProducer.TransactionStateSerializer
TypeSerializer for
FlinkKafkaProducer.KafkaTransactionState . |
static class |
FlinkKafkaProducer011.ContextStateSerializer
|
static class |
FlinkKafkaProducer011.KafkaTransactionContext
Context associated to this instance of the
FlinkKafkaProducer011 . |
static class |
FlinkKafkaProducer011.NextTransactionalIdHintSerializer
|
static class |
FlinkKafkaProducer011.TransactionStateSerializer
TypeSerializer for
KafkaTransactionState . |
class |
FlinkKafkaProducerBase<IN>
Flink Sink to produce data into a Kafka topic.
|
class |
Kafka010TableSink
Kafka 0.10 table sink for writing data into Kafka.
|
class |
Kafka010TableSource
Kafka
StreamTableSource for Kafka 0.10. |
class |
Kafka011TableSink
Kafka 0.11 table sink for writing data into Kafka.
|
class |
Kafka011TableSource
Kafka
StreamTableSource for Kafka 0.11. |
class |
Kafka08TableSink
Kafka 0.8 table sink for writing data into Kafka.
|
class |
Kafka08TableSource
Kafka
StreamTableSource for Kafka 0.8. |
class |
Kafka09TableSink
Kafka 0.9 table sink for writing data into Kafka.
|
class |
Kafka09TableSource
Kafka
StreamTableSource for Kafka 0.9. |
class |
KafkaTableSink
Kafka table sink for writing data into Kafka.
|
class |
KafkaTableSinkBase
A version-agnostic Kafka
AppendStreamTableSink . |
class |
KafkaTableSource
Kafka
StreamTableSource . |
class |
KafkaTableSourceBase
A version-agnostic Kafka
StreamTableSource . |
Modifier and Type | Class and Description |
---|---|
class |
OffsetCommitMode
The offset commit mode represents the behaviour of how offsets are externally committed
back to Kafka brokers / Zookeeper.
|
class |
OffsetCommitModes
Utilities for
OffsetCommitMode . |
class |
StartupMode
Startup modes for the Kafka Consumer.
|
Modifier and Type | Class and Description |
---|---|
class |
Handover
The Handover is a utility to hand over data (a buffer of records) and exception from a
producer thread to a consumer thread.
|
class |
Kafka010Fetcher<T>
A fetcher that fetches data from Kafka brokers via the Kafka 0.10 consumer API.
|
class |
Kafka010PartitionDiscoverer
A partition discoverer that can be used to discover topics and partitions metadata
from Kafka brokers via the Kafka 0.10 high-level consumer API.
|
class |
Kafka09Fetcher<T>
A fetcher that fetches data from Kafka brokers via the Kafka 0.9 consumer API.
|
class |
Kafka09PartitionDiscoverer
A partition discoverer that can be used to discover topics and partitions metadata
from Kafka brokers via the Kafka 0.9 high-level consumer API.
|
class |
KafkaConsumerCallBridge010
The ConsumerCallBridge simply calls the
KafkaConsumer.assign(java.util.Collection) method. |
class |
KafkaConsumerCallBridge09
The ConsumerCallBridge simply calls methods on the
KafkaConsumer . |
class |
KafkaConsumerThread
The thread the runs the
KafkaConsumer , connecting to the brokers and polling records. |
class |
KafkaFetcher<T>
A fetcher that fetches data from Kafka brokers via the Kafka consumer API.
|
class |
KafkaPartitionDiscoverer
A partition discoverer that can be used to discover topics and partitions metadata
from Kafka brokers via the Kafka high-level consumer API.
|
class |
TransactionalIdsGenerator
Class responsible for generating transactional ids to use when communicating with Kafka.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaMetricMutableWrapper
Gauge for getting the current value of a Kafka metric.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractFetcher<T,KPH>
Base class for all fetchers, which implement the connections to Kafka brokers and
pull records from Kafka partitions.
|
class |
AbstractPartitionDiscoverer
Base class for all partition discoverers.
|
class |
ClosableBlockingQueue<E>
A special form of blocking queue with two additions:
The queue can be closed atomically when empty.
|
class |
ExceptionProxy
A proxy that communicates exceptions between threads.
|
class |
Kafka08Fetcher<T>
A fetcher that fetches data from Kafka brokers via the Kafka 0.8 low-level consumer API.
|
class |
Kafka08PartitionDiscoverer
A partition discoverer that can be used to discover topics and partitions metadata
from Kafka brokers via the Kafka 0.8 low-level consumer API.
|
interface |
KafkaCommitCallback
A callback interface that the source operator can implement to trigger custom actions when a commit request completes,
which should normally be triggered from checkpoint complete event.
|
class |
KafkaDeserializationSchemaWrapper<T>
A simple wrapper for using the DeserializationSchema with the KafkaDeserializationSchema
interface.
|
class |
KafkaTopicPartitionAssigner
Utility for assigning Kafka partitions to consumer subtasks.
|
class |
KafkaTopicPartitionLeader
Serializable Topic Partition info with leader Node information.
|
class |
KafkaTopicPartitionState<KPH>
The state that the Flink Kafka Consumer holds for each Kafka partition.
|
class |
KafkaTopicPartitionStateSentinel
Magic values used to represent special offset states before partitions are actually read.
|
class |
KafkaTopicPartitionStateWithPeriodicWatermarks<T,KPH>
A special version of the per-kafka-partition-state that additionally holds
a periodic watermark generator (and timestamp extractor) per partition.
|
class |
KafkaTopicPartitionStateWithPunctuatedWatermarks<T,KPH>
A special version of the per-kafka-partition-state that additionally holds
a periodic watermark generator (and timestamp extractor) per partition.
|
class |
KafkaTopicsDescriptor
A Kafka Topics Descriptor describes how the consumer subscribes to Kafka topics -
either a fixed list of topics, or a topic pattern.
|
class |
KeyedSerializationSchemaWrapper<T>
A simple wrapper for using the SerializationSchema with the KeyedSerializationSchema
interface.
|
class |
PeriodicOffsetCommitter
A thread that periodically writes the current Kafka partition offsets to Zookeeper.
|
class |
ZookeeperOffsetHandler
Handler for committing Kafka offsets to Zookeeper and to retrieve them again.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaConsumerMetricConstants
A collection of Kafka consumer metrics related constant strings.
|
class |
KafkaMetricWrapper
Gauge for getting the current value of a Kafka metric.
|
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaDelegatePartitioner<T>
Deprecated.
Delegate for
KafkaPartitioner , use FlinkKafkaPartitioner instead |
class |
KafkaPartitioner<T>
Deprecated.
This partitioner does not handle partitioning properly in the case of
multiple topics, and has been deprecated. Please use
FlinkKafkaPartitioner instead. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractBufferStorage
A default abstract based class for
BufferStorage implementations. |
class |
BlockingQueueBroker
Broker for the BlockingQueue used in
StreamIterationHead and
StreamIterationTail for implementing feedback
streams. |
interface |
BufferOrEventSequence
This class represents a sequence of buffers and events which are blocked by
CheckpointedInputGate . |
class |
BufferSpiller
Deprecated.
|
interface |
BufferStorage
The
BufferStorage takes the buffers and events from a data stream and adds them in a sequence. |
class |
CachedBufferStorage
The
CachedBufferStorage takes the buffers and events from a data stream and adds them to
a memory queue. |
class |
CheckpointBarrierAligner
CheckpointBarrierAligner keep tracks of received CheckpointBarrier on given
channels and controls the alignment, by deciding which channels should be blocked and when to
release blocked channels. |
class |
CheckpointBarrierTracker
The
CheckpointBarrierTracker keeps track of what checkpoint barriers have been received from
which input channels. |
class |
CheckpointedInputGate
The
CheckpointedInputGate uses CheckpointBarrierHandler to handle incoming
CheckpointBarrier from the InputGate . |
class |
EmptyBufferStorage
Always empty implementation of
BufferStorage . |
class |
InputGateUtil
Utility for dealing with input gates.
|
class |
InputProcessorUtil
Utility for creating
CheckpointedInputGate based on checkpoint mode
for StreamOneInputProcessor and StreamTwoInputProcessor . |
class |
RecordWriterOutput<OUT>
Implementation of
Output that sends data using a RecordWriter . |
interface |
StreamInputProcessor
Interface for processing records by
StreamTask . |
class |
StreamOneInputProcessor<IN>
Input reader for
OneInputStreamTask . |
interface |
StreamTaskInput
Basic interface for inputs of stream operators.
|
class |
StreamTaskNetworkInput
Implementation of
StreamTaskInput that wraps an input from network taken from CheckpointedInputGate . |
class |
StreamTwoInputProcessor<IN1,IN2>
Input reader for
TwoInputStreamTask . |
class |
StreamTwoInputSelectableProcessor<IN1,IN2>
Input reader for
TwoInputSelectableStreamTask
in the case that the operator is InputSelectable. |
Modifier and Type | Class and Description |
---|---|
class |
EvictingWindowOperator<K,IN,OUT,W extends Window>
A
WindowOperator that also allows an Evictor to be used. |
class |
KeyMap<K,V>
A special Hash Map implementation that can be traversed efficiently in sync with other
hash maps.
|
class |
WindowOperator<K,IN,ACC,OUT,W extends Window>
An operator that implements the logic for windowing based on a
WindowAssigner and
Trigger . |
Modifier and Type | Class and Description |
---|---|
class |
InternalProcessAllWindowContext<IN,OUT,W extends Window>
Internal reusable context wrapper.
|
class |
InternalProcessWindowContext<IN,OUT,KEY,W extends Window>
Internal reusable context wrapper.
|
Modifier and Type | Class and Description |
---|---|
class |
BroadcastPartitioner<T>
Partitioner that selects all the output channels.
|
class |
CustomPartitionerWrapper<K,T>
Partitioner that selects the channel with a user defined partitioner function on a key.
|
class |
ForwardPartitioner<T>
Partitioner that forwards elements only to the locally running downstream operation.
|
class |
GlobalPartitioner<T>
Partitioner that sends all elements to the downstream operator with subtask ID=0.
|
class |
KeyGroupStreamPartitioner<T,K>
Partitioner selects the target channel based on the key group index.
|
class |
RebalancePartitioner<T>
Partitioner that distributes the data equally by cycling through the output
channels.
|
class |
RescalePartitioner<T>
Partitioner that distributes the data equally by cycling through the output
channels.
|
class |
ShufflePartitioner<T>
Partitioner that distributes the data equally by selecting one output channel
randomly.
|
class |
StreamPartitioner<T>
A special
ChannelSelector for use in streaming programs. |
Modifier and Type | Class and Description |
---|---|
class |
StreamElement
An element in a data stream.
|
class |
StreamElementSerializer<T>
|
class |
StreamRecord<T>
One value in a data stream.
|
Modifier and Type | Class and Description |
---|---|
class |
StatusWatermarkValve
A
StatusWatermarkValve embodies the logic of how Watermark and StreamStatus are propagated to
downstream outputs, given a set of one or multiple input channels that continuously receive them. |
class |
StreamStatus
A Stream Status element informs stream tasks whether or not they should continue to expect records and watermarks
from the input stream that sent them.
|
interface |
StreamStatusMaintainer
Interface that allows toggling the current
StreamStatus as well as retrieving it. |
interface |
StreamStatusProvider
Interface for retrieving the current
StreamStatus . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractTwoInputStreamTask<IN1,IN2,OUT>
Abstract class for executing a
TwoInputStreamOperator . |
class |
AsynchronousException
An exception for wrapping exceptions that are thrown by an operator in threads other than the
main compute thread of that operator.
|
class |
ExceptionInChainedOperatorException
A special exception that signifies that the cause exception came from a chained operator.
|
class |
OneInputStreamTask<IN,OUT>
A
StreamTask for executing a OneInputStreamOperator . |
class |
OperatorChain<OUT,OP extends StreamOperator<OUT>>
The
OperatorChain contains all operators that are executed as one chain within a single
StreamTask . |
interface |
ProcessingTimeCallback
Interface for processing-time callbacks that can be registered at a
ProcessingTimeService . |
class |
SourceStreamTask<OUT,SRC extends SourceFunction<OUT>,OP extends StreamSource<OUT,SRC>>
StreamTask for executing a StreamSource . |
class |
StreamIterationHead<OUT>
A special
StreamTask that is used for executing feedback edges. |
class |
StreamIterationTail<IN>
A special
StreamTask that is used for executing feedback edges. |
class |
StreamTask<OUT,OP extends StreamOperator<OUT>>
Base class for all streaming tasks.
|
class |
StreamTaskException
An exception that is thrown by the stream vertices when encountering an
illegal condition.
|
class |
TimerException
RuntimeException for wrapping exceptions that are thrown in the timer callback of
the timer service in StreamTask . |
class |
TwoInputSelectableStreamTask<IN1,IN2,OUT>
A
StreamTask for executing a TwoInputStreamOperator and supporting
the TwoInputStreamOperator to select input for reading. |
class |
TwoInputStreamTask<IN1,IN2,OUT>
A
StreamTask that executes a TwoInputStreamOperator but does not support
the TwoInputStreamOperator to select input for reading. |
Modifier and Type | Class and Description |
---|---|
class |
StreamingFunctionUtils
Utility class that contains helper methods to work with Flink Streaming
Functions . |
Modifier and Type | Class and Description |
---|---|
class |
KeySelectorUtil
Utility class that contains helper methods to manipulating
KeySelector for streaming. |
Modifier and Type | Class and Description |
---|---|
class |
FieldAccessor<T,F>
These classes encapsulate the logic of accessing a field specified by the user as either an index
or a field expression string.
|
class |
FieldAccessorFactory
Static factories for the
FieldAccessor utilities. |
Modifier and Type | Method and Description |
---|---|
static <T,F> FieldAccessor<T,F> |
FieldAccessorFactory.getAccessor(TypeInformation<T> typeInfo,
int pos,
ExecutionConfig config)
Creates a
FieldAccessor for the given field position, which can be used to get and set
the specified field on instances of this type. |
static <T,F> FieldAccessor<T,F> |
FieldAccessorFactory.getAccessor(TypeInformation<T> typeInfo,
String field,
ExecutionConfig config)
Creates a
FieldAccessor for the field that is given by a field expression,
which can be used to get and set the specified field on instances of this type. |
Modifier and Type | Method and Description |
---|---|
Map<String,String> |
EnvironmentSettings.toExecutorProperties() |
Map<String,String> |
EnvironmentSettings.toPlannerProperties() |
Constructor and Description |
---|
StreamQueryConfig(long minIdleStateRetentionTime,
long maxIdleStateRetentionTime)
Deprecated.
|
Modifier and Type | Class and Description |
---|---|
class |
TableEnvironmentImpl
Implementation of
TableEnvironment that works exclusively with Table API interfaces. |
class |
TableImpl
Implementation for
Table . |
Modifier and Type | Class and Description |
---|---|
class |
StreamTableEnvironmentImpl
The implementation for a Java
StreamTableEnvironment . |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
StreamTableEnvironmentImpl.execEnv()
This is a temporary workaround for Python API.
|
Modifier and Type | Class and Description |
---|---|
class |
CatalogCalciteSchema
A mapping between Flink's catalog and Calcite's schema.
|
class |
CatalogManager
A CatalogManager that encapsulates all available catalogs.
|
class |
CatalogManagerCalciteSchema
Bridge between the
CatalogManager and the Schema . |
class |
CatalogReader
A thin wrapper around
CalciteCatalogReader that enables providing multiple
default paths to look in. |
class |
ConnectorCatalogTable<T1,T2>
|
class |
FunctionCatalog
Simple function catalog to store
FunctionDefinition s in catalogs. |
class |
FunctionCatalogOperatorTable
Thin adapter between
SqlOperatorTable and FunctionCatalog . |
interface |
FunctionLookup
Catalog of functions that can resolve the name of a function to a
FunctionLookup.Result . |
class |
QueryOperationCatalogView
A view created from a
QueryOperation via operations on Table . |
class |
QueryOperationCatalogViewTable
A bridge between a Flink's specific
QueryOperationCatalogView and a Calcite's
Table . |
Modifier and Type | Class and Description |
---|---|
class |
HiveMetastoreClientWrapper
Wrapper class for Hive Metastore Client, which embeds a HiveShim layer to handle different Hive versions.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveTypeUtil
Utils to convert data types between Flink and Hive.
|
Modifier and Type | Class and Description |
---|---|
class |
ListViewSerializer<T>
A serializer for [[ListView]].
|
class |
ListViewSerializerSnapshot<T>
A
TypeSerializerSnapshot for the ListViewSerializer . |
class |
ListViewTypeInfo<T>
Type information for
ListView . |
class |
ListViewTypeInfoFactory<T>
TypeInformation factory for
ListView . |
class |
MapViewSerializer<K,V>
A serializer for
MapView . |
class |
MapViewSerializerSnapshot<K,V>
A
TypeSerializerSnapshot for the MapViewSerializer . |
class |
MapViewTypeInfo<K,V>
TypeInformation for
MapView . |
class |
MapViewTypeInfoFactory<K,V>
TypeInformation factory for
MapView . |
class |
NullAwareMapSerializer<K,V>
The
NullAwareMapSerializer is similar to MapSerializer, the only difference is that
the NullAwareMapSerializer can handle null keys. |
class |
NullAwareMapSerializerSnapshot<K,V>
A
TypeSerializerSnapshot for the NullAwareMapSerializer . |
class |
NullSerializer
A serializer for null.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Executor
It enables execution of a
Transformation s graph generated by
Planner . |
interface |
ExecutorFactory
Factory that creates
Executor . |
interface |
Planner
This interface serves two purposes:
SQL parser - transforms a SQL string into a Table API specific tree of
Operation s
relational planner - provides a way to plan, optimize and transform tree of
ModifyOperation into a runnable form (Transformation )
. |
interface |
PlannerExpressionParser
Temporary utility for parsing expressions inside a String.
|
interface |
PlannerFactory
Factory that creates
Planner . |
interface |
PlannerTypeInferenceUtil
Temporary utility for validation and output type inference until all
PlannerExpression are
upgraded to work with TypeInferenceUtil . |
Modifier and Type | Class and Description |
---|---|
class |
AvroValidator
Validator for
Avro . |
class |
CatalogDescriptorValidator
Validator for
CatalogDescriptor . |
class |
ClassInstanceValidator
Validator for
ClassInstance . |
class |
ConnectorDescriptorValidator
Validator for
ConnectorDescriptor . |
class |
CsvValidator
Validator for
Csv . |
class |
DescriptorProperties
Utility class for having a unified string-based representation of Table API related classes
such as TableSchema, TypeInformation, etc.
|
interface |
DescriptorValidator
Validator for a descriptor.
|
class |
ElasticsearchValidator
The validator for
Elasticsearch . |
class |
ExternalCatalogDescriptorValidator
Deprecated.
use
CatalogDescriptorValidator instead. |
class |
FormatDescriptorValidator
Validator for
FormatDescriptor . |
class |
FunctionDescriptorValidator
Validator for
FunctionDescriptor . |
class |
HBaseValidator
The validator for HBase.
|
class |
HierarchyDescriptorValidator
Validator for a
HierarchyDescriptor . |
class |
JDBCValidator
The validator for JDBC.
|
class |
JsonValidator
Validator for
Json . |
class |
KafkaValidator
The validator for
Kafka . |
class |
LiteralValueValidator
Validator for
LiteralValue . |
class |
MetadataValidator
Validator for
Metadata . |
class |
OldCsvValidator
Deprecated.
Use the RFC-compliant
Csv format in the dedicated
flink-formats/flink-csv module instead. |
class |
StatisticsValidator
Validator for
Statistics . |
class |
StreamTableDescriptorValidator
Validator for
StreamTableDescriptor . |
Modifier and Type | Class and Description |
---|---|
class |
CustomConnectorDescriptor
Describes a custom connector to an other system.
|
class |
CustomFormatDescriptor
Describes the custom format of data.
|
Modifier and Type | Class and Description |
---|---|
class |
StreamExecutor
An implementation of
Executor that is backed by a StreamExecutionEnvironment . |
class |
StreamExecutorFactory
Factory to create an implementation of
Executor to use in a
TableEnvironment . |
Modifier and Type | Class and Description |
---|---|
class |
ApiExpressionVisitor<R>
A visitor for all
Expression s that might be created during API translation. |
class |
ExpressionDefaultVisitor<T>
Implementation of
ExpressionVisitor that redirects all calls to ExpressionDefaultVisitor.defaultMethod(Expression) . |
class |
ExpressionParser
Parser for expressions inside a String.
|
class |
ExpressionUtils
Utility methods for working with
Expression s. |
class |
LocalReferenceExpression
Reference to entity local to a certain
QueryOperation . |
class |
PlannerTypeInferenceUtilImpl
Implementation of
PlannerTypeInferenceUtil . |
class |
ResolvedExpressionVisitor<R>
A visitor for all
ResolvedExpression s. |
Modifier and Type | Class and Description |
---|---|
class |
ExpressionResolver
Tries to resolve all unresolved expressions such as
UnresolvedReferenceExpression
or calls such as BuiltInFunctionDefinitions.OVER . |
class |
LookupCallResolver
Resolves calls with function names to calls with actual function definitions.
|
Modifier and Type | Class and Description |
---|---|
class |
FieldReferenceLookup
Provides a way to look up field reference by the name of the field.
|
interface |
TableReferenceLookup
Provides a way to look up table reference by the name of the table.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ResolverRule
Rule that can be applied during resolution of
Expression . |
class |
ResolverRules
Contains instances of
ResolverRule . |
Modifier and Type | Class and Description |
---|---|
class |
ApiExpressionDefaultVisitor<T>
A utility
ApiExpressionVisitor that calls ApiExpressionDefaultVisitor.defaultMethod(Expression) by default,
unless other methods are overridden explicitly. |
class |
ApiExpressionUtils
Utilities for API-specific
Expression s. |
class |
ResolvedExpressionDefaultVisitor<T>
A utility
ResolvedExpressionVisitor that calls ResolvedExpressionDefaultVisitor.defaultMethod(ResolvedExpression)
by default, unless other methods are overridden explicitly. |
Modifier and Type | Class and Description |
---|---|
class |
ComponentFactoryService
Unified class to search for a
ComponentFactory of provided type and properties. |
Modifier and Type | Class and Description |
---|---|
class |
BuiltInFunctionDefinition
Definition of a built-in function.
|
class |
TemporalTableFunctionImpl
Class representing temporal table function over some history table.
|
class |
UserFunctionsTypeHelper
Utility methods for validation and extraction of types during function registration in a
FunctionCatalog . |
Modifier and Type | Class and Description |
---|---|
class |
DeferredObjectAdapter
Adapter from Java Object to Hive DeferredObject.
|
interface |
HiveFunction
Interface for Hive simple udf, generic udf, and generic udtf.
|
class |
HiveFunctionWrapper<UDFType>
A wrapper of Hive functions that instantiate function instances and ser/de functino instance cross process boundary.
|
class |
HiveGenericUDAF
|
class |
HiveGenericUDF
A ScalarFunction implementation that calls Hive's
GenericUDF . |
class |
HiveGenericUDTF
A TableFunction implementation that calls Hive's
GenericUDTF . |
class |
HiveScalarFunction<UDFType>
Abstract class to provide more information for Hive
UDF and GenericUDF functions. |
class |
HiveSimpleUDF
A ScalarFunction implementation that calls Hive's
UDF . |
Modifier and Type | Class and Description |
---|---|
class |
HiveInspectors
Util for any ObjectInspector related inspection and conversion of Hive data to/from Flink data.
|
interface |
HiveObjectConversion
Interface to convert Flink object to Hive object.
|
class |
IdentityConversion
Conversion that return the same object.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveFunctionUtil
Util for Hive functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AggregateQueryOperation
Relational operation that performs computations on top of subsets of input rows grouped by
key.
|
class |
CalculatedQueryOperation<T>
Describes a relational operation that was created from applying a
TableFunction . |
class |
CatalogQueryOperation
Describes a relational operation that was created from a lookup to a catalog.
|
class |
CatalogSinkModifyOperation
DML operation that tells to write to a sink.
|
class |
DataSetQueryOperation<E>
Describes a relational operation that reads from a
DataSet . |
class |
DistinctQueryOperation
Removes duplicated rows of underlying relational operation.
|
class |
FilterQueryOperation
Filters out rows of underlying relational operation that do not match given condition.
|
class |
JavaDataStreamQueryOperation<E>
Describes a relational operation that reads from a
DataStream . |
class |
JoinQueryOperation
Table operation that joins two relational operations based on given condition.
|
interface |
ModifyOperation
A
Operation that describes the DML queries such as e.g. |
interface |
ModifyOperationVisitor<T>
Class that implements visitor pattern.
|
class |
OperationUtils
Helper methods for
Operation s. |
class |
OutputConversionModifyOperation
Special, internal kind of
ModifyOperation that allows converting a tree of
QueryOperation s to a Transformation of given type described with
TypeInformation . |
class |
ProjectQueryOperation
Table operation that computes new table using given
Expression s
from its input relational operation. |
interface |
QueryOperation
Base class for representing an operation structure behind a user-facing
Table API. |
interface |
QueryOperationVisitor<T>
Class that implements visitor pattern.
|
class |
ScalaDataStreamQueryOperation<E>
Describes a relational operation that reads from a
DataStream . |
class |
SetQueryOperation
A set operation on two relations.
|
class |
SortQueryOperation
Expresses sort operation of rows of the underlying relational operation with given order.
|
class |
TableSourceQueryOperation<T>
Inline scan of a
TableSource . |
class |
UnregisteredSinkModifyOperation<T>
DML operation that tells to write to the given sink.
|
class |
WindowAggregateQueryOperation
Relational operation that performs computations on top of subsets of input rows grouped by
key and group window.
|
static class |
WindowAggregateQueryOperation.ResolvedGroupWindow
Wrapper for resolved expressions of a
GroupWindow . |
Modifier and Type | Interface and Description |
---|---|
interface |
CreateOperation
A
Operation that describes the DDL statements, e.g. |
Modifier and Type | Class and Description |
---|---|
class |
OperationExpressionsUtils
Utility methods for transforming
Expression to use them in QueryOperation s. |
class |
OperationTreeBuilder
A builder for constructing validated
QueryOperation s. |
class |
QueryOperationDefaultVisitor<T>
A utility
QueryOperationVisitor that calls
QueryOperationDefaultVisitor.defaultMethod(QueryOperation)
by default, unless other methods are overridden explicitly. |
Modifier and Type | Class and Description |
---|---|
class |
AggregateOperationFactory
Utility class for creating a valid
AggregateQueryOperation or WindowAggregateQueryOperation . |
class |
AliasOperationUtils
Utility class for creating valid alias expressions that can be later used as a projection.
|
class |
CalculatedTableFactory
Utility class for creating a valid
CalculatedQueryOperation operation. |
class |
ColumnOperationUtils
Utility class for creating projection expressions from column operation.
|
class |
JoinOperationFactory
Utility class for creating a valid
JoinQueryOperation operation. |
class |
ProjectionOperationFactory
Utility class for creating valid
ProjectQueryOperation operation. |
class |
SetOperationFactory
Utility class for creating a valid
SetQueryOperation . |
class |
SortOperationFactory
Utility class for creating a valid
SortQueryOperation operation. |
Modifier and Type | Class and Description |
---|---|
class |
QueryOperationConverter
Converter from Flink's specific relational representation:
QueryOperation to Calcite's specific relational
representation: RelNode . |
Modifier and Type | Class and Description |
---|---|
class |
PlanningConfigurationBuilder
Utility class to create
RelBuilder or FrameworkConfig used to create
a corresponding Planner . |
class |
StreamPlannerFactory
Factory to construct a
StreamPlanner . |
Modifier and Type | Class and Description |
---|---|
class |
CatalogCalciteSchema
A mapping between Flink's catalog and Calcite's schema.
|
class |
CatalogManagerCalciteSchema
Bridge between the
CatalogManager and the Schema . |
class |
FunctionCatalogOperatorTable
Thin adapter between
SqlOperatorTable and FunctionCatalog . |
class |
QueryOperationCatalogViewTable
A bridge between a Flink's specific
QueryOperationCatalogView and a Calcite's
Table . |
Modifier and Type | Class and Description |
---|---|
class |
BatchExecutor
An implementation of
Executor that is backed by a StreamExecutionEnvironment . |
class |
BlinkExecutorFactory
Factory to create an implementation of
Executor to use in a
TableEnvironment . |
class |
BlinkPlannerFactory
Factory to construct a
BatchPlanner or StreamPlanner . |
class |
ExecutorBase
An implementation of
Executor that is backed by a StreamExecutionEnvironment . |
class |
PlannerContext
Utility class to create
RelBuilder or FrameworkConfig used to create
a corresponding Planner . |
class |
StreamExecutor
An implementation of
Executor that is backed by a StreamExecutionEnvironment . |
Modifier and Type | Class and Description |
---|---|
class |
PlannerTypeInferenceUtilImpl
Implementation of
PlannerTypeInferenceUtil . |
Modifier and Type | Class and Description |
---|---|
class |
SqlAuxiliaryGroupAggFunction
An internal [[SqlAggFunction]] to represents auxiliary group keys
which will not be computed as key and does not also affect the correctness of the final result.
|
Modifier and Type | Class and Description |
---|---|
class |
DataStreamQueryOperation<E>
Describes a relational operation that reads from a
DataStream . |
class |
PlannerQueryOperation
Wrapper for valid logical plans generated by Planner.
|
class |
RichTableSourceQueryOperation<T>
A
TableSourceQueryOperation with FlinkStatistic and qualifiedName. |
Modifier and Type | Class and Description |
---|---|
class |
QueryOperationConverter
Converter from Flink's specific relational representation:
QueryOperation to Calcite's specific relational
representation: RelNode . |
Modifier and Type | Interface and Description |
---|---|
interface |
BundleTrigger<T>
A
BundleTrigger determines when a bundle of input elements should be evaluated and
trigger the callback which registered previously. |
interface |
BundleTriggerCallback
Interface for bundle trigger callbacks that can be registered to a
BundleTrigger . |
interface |
CoBundleTrigger<IN1,IN2>
A
CoBundleTrigger is similar with BundleTrigger , and the only differences is
CoBundleTrigger can handle two inputs. |
Modifier and Type | Class and Description |
---|---|
class |
BaseTwoInputStreamOperatorWithStateRetention
An abstract
TwoInputStreamOperator that allows its subclasses to clean
up their state based on a TTL. |
Modifier and Type | Class and Description |
---|---|
class |
BinaryGenericSerializer<T>
Serializer for
BinaryGeneric . |
class |
BinaryStringSerializer
Serializer for
BinaryString . |
class |
DecimalSerializer
Serializer for
Decimal . |
Modifier and Type | Class and Description |
---|---|
class |
StreamRecordCollector<T>
|
Modifier and Type | Class and Description |
---|---|
class |
CsvTableSinkFactoryBase
Factory base for creating configured instances of
CsvTableSink . |
class |
TableSinkBase<T>
Base class for
TableSink . |
Modifier and Type | Class and Description |
---|---|
class |
CsvTableSourceFactoryBase
Factory base for creating configured instances of
CsvTableSource . |
class |
TableSourceValidation
Logic to validate
TableSource types. |
Modifier and Type | Class and Description |
---|---|
class |
InputTypeValidators
Validators for checking the input data types of a function call.
|
class |
TypeInferenceUtil
Utility for performing type inference.
|
class |
TypeStrategies
Strategies for inferring an output or accumulator data type of a function call.
|
Modifier and Type | Class and Description |
---|---|
class |
MissingTypeStrategy
Placeholder for a missing type strategy.
|
Modifier and Type | Class and Description |
---|---|
class |
PassingTypeValidator
Validator that does not perform any validation and always passes.
|
Modifier and Type | Class and Description |
---|---|
class |
LegacyTypeInformationType<T>
This type is a temporary solution to fully support the old type system stack through the new
stack.
|
class |
TimestampKind
Internal timestamp kind for attaching time attribute metadata to timestamps with or without a
time zone.
|
Modifier and Type | Method and Description |
---|---|
TimestampKind |
TimestampType.getKind() |
TimestampKind |
ZonedTimestampType.getKind() |
TimestampKind |
LocalZonedTimestampType.getKind() |
AnyType<T> |
TypeInformationAnyType.resolve(ExecutionConfig config) |
Constructor and Description |
---|
LocalZonedTimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
TimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
ZonedTimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
Modifier and Type | Class and Description |
---|---|
class |
LogicalTypeCasts
Utilities for casting
LogicalType . |
class |
LogicalTypeChecks
Utilities for checking
LogicalType and avoiding a lot of type casting and repetitive work. |
class |
LogicalTypeDefaultVisitor<R>
Implementation of
LogicalTypeVisitor that redirects all calls to
LogicalTypeDefaultVisitor.defaultMethod(LogicalType) . |
class |
LogicalTypeDuplicator
Returns a deep copy of a
LogicalType . |
class |
LogicalTypeGeneralization
Utilities for finding a common, more general
LogicalType for a given set of types. |
class |
LogicalTypeUtils
Utilities for handling
LogicalType s. |
Modifier and Type | Class and Description |
---|---|
class |
ClassDataTypeConverter
Class-based data type extractor that supports extraction of clearly identifiable data types for
input and output conversion.
|
class |
DataTypeDefaultVisitor<R>
Implementation of
DataTypeVisitor that redirects all calls to
DataTypeDefaultVisitor.defaultMethod(DataType) . |
class |
DataTypeUtils
Utilities for handling
DataType s. |
class |
LegacyTypeInfoDataTypeConverter
Converter between
TypeInformation and DataType that reflects the behavior before
Flink 1.9. |
class |
TypeConversions
|
class |
ValueDataTypeConverter
Value-based data type extractor that supports extraction of clearly identifiable data types for
input conversion.
|
Modifier and Type | Class and Description |
---|---|
class |
InternalTypeInfo<T>
Type information for internal types of the Table API that are for translation purposes only
and should not be contained in final plan.
|
class |
TimeIndicatorTypeInfo
Deprecated.
This class will be removed in future versions as it is used for the old type system. It
is recommended to use
DataTypes instead. Please make sure to use either the old
or the new type system consistently to avoid unintended behavior. See the website documentation
for more information. |
class |
TimeIntervalTypeInfo<T>
Deprecated.
This class will be removed in future versions as it is used for the old type system. It
is recommended to use
DataTypes instead. Please make sure to use either the old
or the new type system consistently to avoid unintended behavior. See the website documentation
for more information. |
Modifier and Type | Class and Description |
---|---|
class |
EncodingUtils
General utilities for string-encoding.
|
class |
TableConnectorUtils
Utilities for table sources and sinks.
|
class |
ThreadLocalCache<K,V>
Provides a thread local cache with a maximum cache size per thread.
|
Modifier and Type | Class and Description |
---|---|
class |
TestingSecurityContext
Test security context to support handling both client and server principals in MiniKDC.
|
Modifier and Type | Method and Description |
---|---|
static <L,R> Either.Left<L,R> |
Either.obtainLeft(Either<L,R> input,
TypeSerializer<L> leftSerializer)
Utility function for
EitherSerializer to support object reuse. |
static <L,R> Either.Right<L,R> |
Either.obtainRight(Either<L,R> input,
TypeSerializer<R> rightSerializer)
Utility function for
EitherSerializer to support object reuse. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractCloseableRegistry<C extends Closeable,T>
This is the abstract base class for registries that allow to register instances of
Closeable , which are all
closed if this registry is closed. |
class |
ArrayUtils
Utility class for Java arrays.
|
class |
CollectionUtil
Simple utility to work with Java collections.
|
class |
ExceptionUtils
A collection of utility functions for dealing with exceptions and exception workflows.
|
class |
InstantiationUtil
Utility class to create instances from class objects and checking failure reasons.
|
interface |
IterableIterator<E>
|
class |
LinkedOptionalMap<K,V>
A LinkedOptionalMap is an order preserving map (like
LinkedHashMap ) where keys have a unique string name, but are
optionally present, and the values are optional. |
class |
LinkedOptionalMapSerializer
LinkedOptionalMapSerializer - A serializer of
LinkedOptionalMap . |
interface |
MutableObjectIterator<E>
A simple iterator interface.
|
class |
NetUtils
Utility for various network related tasks (such as finding free ports).
|
class |
OperatingSystem
An enumeration indicating the operating system that the JVM runs on.
|
class |
Preconditions
A collection of static utility methods to validate input.
|
class |
ReflectionUtil
Utility for reflection operations on classes and generic type parametrization.
|
class |
SerializedValue<T>
This class is used to transfer (via serialization) objects whose classes are not available
in the system class loader.
|
class |
UnionIterator<T>
An iterator that concatenates a collection of iterators.
|
interface |
Visitable<T extends Visitable<T>>
This interface marks types as visitable during a traversal.
|
interface |
Visitor<T extends Visitable<T>>
A visitor encapsulates functionality that is applied to each node in the process of a traversal of a tree or DAG.
|
interface |
WrappingProxy<T>
Interface for objects that wrap another object and proxy (possibly a subset) of
the methods of that object.
|
class |
WrappingProxyUtil
Utilities for working with
WrappingProxy . |
Modifier and Type | Class and Description |
---|---|
class |
NeverCompleteFuture
A future that never completes.
|
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.