Modifier and Type | Class and Description |
---|---|
class |
ProcedureNamespace
Namespace whose contents are defined by the result of a call to a user-defined procedure.
|
Modifier and Type | Class and Description |
---|---|
interface |
VisibleForTesting
This annotations declares that a function, field, constructor, or entire type, is only visible
for testing purposes.
|
Modifier and Type | Class and Description |
---|---|
interface |
ConfigGroup
A class that specifies a group of config options.
|
interface |
ConfigGroups
Annotation used on classes containing config options that enables the separation of options into
different tables based on key prefixes.
|
static interface |
Documentation.ExcludeFromDocumentation
Annotation used on config option fields or REST API message headers to exclude it from
documentation.
|
static interface |
Documentation.OverrideDefault
Annotation used on config option fields to override the documented default.
|
static interface |
Documentation.Section
Annotation used on config option fields to include them in specific sections.
|
static interface |
Documentation.SuffixOption
Annotation used on config option fields or options class to mark them as a suffix-option;
i.e., a config option where the key is only a suffix, with the prefix being dynamically
provided at runtime.
|
static interface |
Documentation.TableOption
Annotation used on table config options for adding meta data labels.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Archiveable<T extends Serializable> |
class |
ArchivedExecutionConfig
Serializable class which is created when archiving the job.
|
class |
Plan
This class represents Flink programs, in the form of dataflow plans.
|
class |
TaskInfo
Encapsulates task-specific information: name, index of subtask, parallelism and attempt number.
|
Modifier and Type | Method and Description |
---|---|
ArchivedExecutionConfig |
ExecutionConfig.archive() |
int |
ExecutionConfig.getMaterializationMaxAllowedFailures() |
long |
ExecutionConfig.getPeriodicMaterializeIntervalMillis() |
boolean |
ExecutionConfig.isDynamicGraph() |
boolean |
ExecutionConfig.isLatencyTrackingConfigured() |
void |
ExecutionConfig.setDynamicGraph(boolean dynamicGraph) |
void |
ExecutionConfig.setMaterializationMaxAllowedFailures(int materializationMaxAllowedFailures) |
void |
ExecutionConfig.setPeriodicMaterializeIntervalMillis(java.time.Duration periodicMaterializeInterval) |
Modifier and Type | Class and Description |
---|---|
class |
AccumulatorHelper
Helper functions for the interaction with
Accumulator . |
Modifier and Type | Class and Description |
---|---|
class |
AggregatorRegistry
A registry for iteration
Aggregator s. |
Modifier and Type | Class and Description |
---|---|
class |
CommonRangeBoundaries<T> |
Modifier and Type | Class and Description |
---|---|
class |
IndexedCombinedWatermarkStatus
Represents combined value and status of a watermark for a set number of input partial watermarks.
|
class |
WatermarkOutputMultiplexer
A
WatermarkOutputMultiplexer combines the watermark (and idleness) updates of multiple
partitions/shards/splits into one combined watermark update and forwards it to an underlying
WatermarkOutput . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractRuntimeUDFContext
A standalone implementation of the
RuntimeContext , created by runtime UDF operators. |
class |
CopyingIterator<E>
Wraps an iterator to return deep copies of the original iterator's elements.
|
class |
CopyingListCollector<T>
A
Collector that collects deep copies of its elements in a list. |
class |
FunctionUtils
Utility class that contains helper methods to work with Flink
Function class. |
class |
ListCollector<T>
A
Collector that puts the collected elements into a given list. |
class |
NoOpFunction
An
AbstractRichFunction that does nothing. |
class |
PrintSinkOutputWriter<IN>
Print sink output writer for DataStream and DataSet print API.
|
class |
RuntimeUDFContext
A standalone implementation of the
RuntimeContext , created by runtime UDF operators. |
Modifier and Type | Method and Description |
---|---|
String |
AbstractRuntimeUDFContext.getAllocationIDAsString() |
Modifier and Type | Class and Description |
---|---|
class |
DefaultInputSplitAssigner
This is the default implementation of the
InputSplitAssigner interface. |
class |
GenericCsvInputFormat<OT> |
class |
GlobFilePathFilter
Class for determining if a particular file should be included or excluded based on a set of
include and exclude glob filters.
|
class |
ReplicatingInputSplitAssigner
Assigns each InputSplit to each requesting parallel instance.
|
Modifier and Type | Class and Description |
---|---|
class |
Bzip2InputStreamFactory
Factory for Bzip2 decompressors.
|
class |
DeflateInflaterInputStreamFactory
Factory for input streams that decompress the "deflate" compression format.
|
class |
GzipInflaterInputStreamFactory
Factory for input streams that decompress the GZIP compression format.
|
interface |
InflaterInputStreamFactory<T extends InputStream>
Creates a new instance of a certain subclass of
InflaterInputStream . |
class |
XZInputStreamFactory
Factory for XZ decompressors.
|
class |
ZStandardInputStreamFactory
Factory for ZStandard decompressors.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractUdfOperator<OUT,FT extends Function>
Abstract superclass for all contracts that represent actual operators.
|
class |
BinaryOperatorInformation<IN1,IN2,OUT>
A class for holding information about a single input operator, such as input/output
TypeInformation.
|
class |
CollectionExecutor
Execution utility for serial, local, collection-based executions of Flink programs.
|
class |
CompilerHints
A class encapsulating compiler hints describing the behavior of the user function.
|
class |
DualInputOperator<IN1,IN2,OUT,FT extends Function>
Abstract operator superclass for all operators that have two inputs, like "Join", "CoGroup", or
"Cross".
|
class |
DualInputSemanticProperties
Container for the semantic properties associated to a dual input operator.
|
class |
GenericDataSinkBase<IN>
Operator for nodes that act as data sinks, storing the data they receive.
|
class |
GenericDataSourceBase<OUT,T extends InputFormat<OUT,?>>
Abstract superclass for data sources in a Pact plan.
|
interface |
IterationOperator |
class |
Keys<T> |
class |
Operator<OUT>
Abstract base class for all operators.
|
class |
OperatorInformation<OUT>
A class for holding information about an operator, such as input/output TypeInformation.
|
class |
Ordering
This class represents an ordering on a set of fields.
|
class |
ResourceSpec
Describe the different resource factors of the operator with UDF.
|
interface |
SemanticProperties
Container for the semantic properties associated to an operator.
|
class |
SingleInputOperator<IN,OUT,FT extends Function>
Abstract superclass for for all operators that have one input like "map" or "reduce".
|
class |
SingleInputSemanticProperties
Container for the semantic properties associated to a single input operator.
|
class |
UnaryOperatorInformation<IN,OUT>
A class for holding information about a single input operator, such as input/output
TypeInformation.
|
class |
Union<T>
This operator represents a Union between two inputs.
|
Modifier and Type | Class and Description |
---|---|
class |
BulkIterationBase<T> |
class |
CoGroupOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>> |
class |
CoGroupRawOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>> |
class |
CrossOperatorBase<IN1,IN2,OUT,FT extends CrossFunction<IN1,IN2,OUT>> |
class |
DeltaIterationBase<ST,WT>
A DeltaIteration is similar to a
BulkIterationBase , but maintains state across the
individual iteration steps. |
class |
FilterOperatorBase<T,FT extends FlatMapFunction<T,T>> |
class |
FlatMapOperatorBase<IN,OUT,FT extends FlatMapFunction<IN,OUT>> |
class |
GroupCombineOperatorBase<IN,OUT,FT extends GroupCombineFunction<IN,OUT>>
Base operator for the combineGroup transformation.
|
class |
GroupReduceOperatorBase<IN,OUT,FT extends GroupReduceFunction<IN,OUT>> |
class |
InnerJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
JoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
MapOperatorBase<IN,OUT,FT extends MapFunction<IN,OUT>> |
class |
MapPartitionOperatorBase<IN,OUT,FT extends MapPartitionFunction<IN,OUT>> |
class |
OuterJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>> |
class |
PartitionOperatorBase<IN> |
class |
ReduceOperatorBase<T,FT extends ReduceFunction<T>>
Base data flow operator for Reduce user-defined functions.
|
class |
SortPartitionOperatorBase<IN> |
Modifier and Type | Class and Description |
---|---|
class |
FieldList
Immutable ordered list of fields IDs.
|
class |
FieldSet
Immutable unordered collection of fields IDs.
|
class |
JoinHashMap<BT> |
class |
ListKeyGroupedIterator<E>
The KeyValueIterator returns a key and all values that belong to the key (share the same key).
|
class |
TypeComparable<T>
Wrapper that is used to store elements for which we have a TypeComparator in a Hash Map.
|
class |
UserCodeClassWrapper<T>
This holds a class containing user defined code.
|
class |
UserCodeObjectWrapper<T>
This holds an actual object containing user defined code.
|
interface |
UserCodeWrapper<T>
UDf operators can have either a class or an object containing the user code, this is the common
interface to access them.
|
Modifier and Type | Class and Description |
---|---|
class |
CPUResource
Represents CPU resource.
|
class |
ExternalResource
An external resource.
|
class |
Resource<T extends Resource<T>>
Base class for resources one can specify.
|
Modifier and Type | Class and Description |
---|---|
class |
RuntimeContextInitializationContextAdapters
A set of adapters between
RuntimeContext and DeserializationSchema.InitializationContext or SerializationSchema.InitializationContext . |
Modifier and Type | Interface and Description |
---|---|
interface |
InternalCheckpointListener
The internal checkpoint listener add another
InternalCheckpointListener.notifyCheckpointSubsumed(long) interface
for internal usage. |
Modifier and Type | Method and Description |
---|---|
StateTtlConfig |
StateDescriptor.getTtlConfig() |
Modifier and Type | Class and Description |
---|---|
class |
Deadline
This class stores a deadline, as obtained via
Deadline.now() or from Deadline.plus(Duration) . |
Modifier and Type | Class and Description |
---|---|
class |
BackwardsCompatibleSerializerSnapshot<T>
A utility
TypeSerializerConfigSnapshot that is used for backwards compatibility purposes. |
class |
CompositeTypeSerializerConfigSnapshot<T>
A
TypeSerializerConfigSnapshot for serializers that has multiple nested serializers. |
class |
CompositeTypeSerializerUtil
Utilities for the
CompositeTypeSerializerSnapshot . |
class |
GenericPairComparator<T1,T2> |
class |
GenericTypeSerializerConfigSnapshot<T>
Configuration snapshot for serializers for generic types.
|
class |
GenericTypeSerializerSnapshot<T,S extends TypeSerializer>
Base
TypeSerializerSnapshot for serializers for generic types. |
interface |
LegacySerializerSnapshotTransformer<T>
This interface provides a way for
TypeSerializer s to transform a legacy TypeSerializerSnapshot used in versions before Flink 1.7 during deserialization. |
class |
NestedSerializersSnapshotDelegate
A NestedSerializersSnapshotDelegate represents the snapshots of multiple serializers that are
used by an outer serializer.
|
class |
ParameterlessTypeSerializerConfig<T>
Deprecated.
this snapshot class is no longer used by any serializers, and is maintained only for
backward compatibility reasons. It is fully replaced by
SimpleTypeSerializerSnapshot . |
class |
SameTypePairComparator<T> |
class |
SingleThreadAccessCheckingTypeSerializer<T> |
interface |
TypeComparatorFactory<T> |
class |
TypePairComparator<T1,T2>
This interface defines the method required by the runtime to use data types in join-like
operations.
|
interface |
TypePairComparatorFactory<T1,T2> |
static interface |
TypeSerializerConfigSnapshot.SelfResolvingTypeSerializer<E>
Deprecated.
This interface assists with the migration path to the new serialization abstraction.
|
interface |
TypeSerializerFactory<T> |
class |
TypeSerializerSerializationUtil
Deprecated.
This utility class was used to write serializers into checkpoints. Starting from
Flink 1.6.x, this should no longer happen, and therefore this class is deprecated. It remains
here for backwards compatibility paths.
|
Modifier and Type | Method and Description |
---|---|
ClassLoader |
TypeSerializerConfigSnapshot.getUserCodeClassLoader()
Deprecated.
Returns the user code class loader.
|
void |
TypeSerializerConfigSnapshot.setPriorSerializer(TypeSerializer<T> serializer)
Deprecated.
Set the originating serializer of this configuration snapshot.
|
void |
TypeSerializerConfigSnapshot.setUserCodeClassLoader(ClassLoader userCodeClassLoader)
Deprecated.
Set the user code class loader.
|
Modifier and Type | Class and Description |
---|---|
class |
BasicTypeComparator<T extends Comparable<T>> |
class |
BigDecComparator
Comparator for comparing BigDecimal values.
|
class |
BigDecSerializer
Serializer for serializing/deserializing BigDecimal values including null values.
|
class |
BigIntComparator
Comparator for comparing BigInteger values.
|
class |
BigIntSerializer
Serializer for serializing/deserializing BigInteger values including null values.
|
class |
BooleanComparator |
class |
BooleanSerializer
Type serializer for
Boolean . |
class |
BooleanValueComparator
Specialized comparator for BooleanValue based on CopyableValueComparator.
|
class |
BooleanValueSerializer |
class |
ByteComparator |
class |
ByteSerializer
Type serializer for
Byte . |
class |
ByteValueComparator
Specialized comparator for ByteValue based on CopyableValueComparator.
|
class |
ByteValueSerializer |
class |
CharComparator |
class |
CharSerializer
Type serializer for
Character . |
class |
CharValueComparator
Specialized comparator for CharValue based on CopyableValueComparator.
|
class |
CharValueSerializer |
class |
CollectionSerializerConfigSnapshot<C extends Collection<T>,T>
Deprecated.
this snapshot class should no longer be used by any serializers as their snapshot.
|
class |
DateComparator |
class |
DateSerializer |
class |
DoubleComparator |
class |
DoubleSerializer
Type serializer for
Double . |
class |
DoubleValueComparator
Specialized comparator for DoubleValue based on CopyableValueComparator.
|
class |
DoubleValueSerializer |
class |
EnumComparator<T extends Enum<T>> |
class |
EnumSerializer<T extends Enum<T>>
TypeSerializer for Java enums. |
class |
FloatComparator |
class |
FloatSerializer
Type serializer for
Float . |
class |
FloatValueComparator
Specialized comparator for FloatValue based on CopyableValueComparator.
|
class |
FloatValueSerializer |
class |
GenericArraySerializer<C>
A serializer for arrays of objects.
|
class |
GenericArraySerializerConfigSnapshot<C>
Deprecated.
this is deprecated and no longer used by the
GenericArraySerializer . It has
been replaced by GenericArraySerializerSnapshot . |
class |
InstantComparator
Comparator for comparing Java Instant.
|
class |
InstantSerializer
Serializer for serializing/deserializing Instant values including null values.
|
class |
IntComparator |
class |
IntSerializer
Type serializer for
Integer (and int , via auto-boxing). |
class |
IntValueComparator
Specialized comparator for IntValue based on CopyableValueComparator.
|
class |
IntValueSerializer |
class |
ListSerializer<T>
A serializer for
Lists . |
class |
LocalDateComparator
This class can not extend
BasicTypeComparator , because LocalDate is a Comparable of
ChronoLocalDate instead of Comparable of LocalDate. |
class |
LocalDateSerializer |
class |
LocalDateTimeComparator
This class can not extend
BasicTypeComparator , because LocalDateTime is a Comparable of
ChronoLocalDateTime instead of Comparable of LocalDateTime. |
class |
LocalDateTimeSerializer |
class |
LocalTimeComparator |
class |
LocalTimeSerializer |
class |
LongComparator |
class |
LongSerializer
Type serializer for
Long . |
class |
LongValueComparator
Specialized comparator for LongValue based on CopyableValueComparator.
|
class |
LongValueSerializer |
class |
MapSerializer<K,V>
A serializer for
Map . |
class |
MapSerializerConfigSnapshot<K,V>
Deprecated.
this snapshot class should not be used by any serializer anymore.
|
class |
NormalizedKeyUtil
Utilities related to
TypeComparator . |
class |
NullValueComparator
Specialized comparator for NullValue based on CopyableValueComparator.
|
class |
NullValueSerializer |
class |
ShortComparator |
class |
ShortSerializer
Type serializer for
Byte . |
class |
ShortValueComparator
Specialized comparator for ShortValue based on CopyableValueComparator.
|
class |
ShortValueSerializer |
class |
SqlDateSerializer |
class |
SqlTimeSerializer |
class |
SqlTimestampComparator
Comparator for comparing Java SQL Timestamps.
|
class |
SqlTimestampSerializer |
class |
StringComparator |
class |
StringSerializer
Type serializer for
String . |
class |
StringValueComparator
Specialized comparator for StringValue based on CopyableValueComparator.
|
class |
StringValueSerializer |
class |
TypeSerializerSingleton<T> |
class |
VoidSerializer
Serializer for
Void . |
Modifier and Type | Interface and Description |
---|---|
interface |
SupportsIntermediateNoMoreSplits
A decorative interface of
SplitEnumeratorContext which allows to handle intermediate
NoMoreSplits. |
Modifier and Type | Interface and Description |
---|---|
interface |
Pipeline
Common interface for Flink pipelines.
|
class |
Transformation<T>
A
Transformation represents the operation that creates a DataStream. |
Modifier and Type | Class and Description |
---|---|
class |
ClosureCleaner
The closure cleaner is a utility that tries to truncate the closure (enclosing instance) of
non-static inner classes (created for inline transformation functions).
|
class |
ExecutionPlanUtil
A utility for extracting an execution plan (as JSON) from a
Plan . |
static interface |
ExecutionPlanUtil.ExecutionPlanJSONGenerator
Internal interface for the JSON plan generator that has to reside in the optimizer package.
|
class |
RemoteEnvironmentConfigUtils
A set of tools used by batch and streaming remote environments when preparing their
configurations.
|
class |
Utils
Utility class that contains helper methods to work with Java APIs.
|
Modifier and Type | Method and Description |
---|---|
static boolean |
ExecutionEnvironment.areExplicitEnvironmentsAllowed()
Checks whether it is currently permitted to explicitly instantiate a LocalEnvironment or a
RemoteEnvironment.
|
Plan |
ExecutionEnvironment.createProgramPlan()
Creates the program's
Plan . |
Plan |
ExecutionEnvironment.createProgramPlan(String jobName)
Creates the program's
Plan . |
Plan |
ExecutionEnvironment.createProgramPlan(String jobName,
boolean clearSinks)
Creates the program's
Plan . |
Configuration |
ExecutionEnvironment.getConfiguration() |
PipelineExecutorServiceLoader |
ExecutionEnvironment.getExecutorServiceLoader() |
ClassLoader |
ExecutionEnvironment.getUserCodeClassLoader() |
Modifier and Type | Class and Description |
---|---|
class |
AggregationFunction<T> |
interface |
AggregationFunctionFactory
Interface of factory for creating
AggregationFunction . |
class |
MaxAggregationFunction<T extends Comparable<T>>
Implementation of
AggregationFunction for max operation. |
class |
MinAggregationFunction<T extends Comparable<T>>
Implementations of
AggregationFunction for min operation. |
class |
SumAggregationFunction<T>
Definitions of sum functions for different numerical types.
|
Modifier and Type | Class and Description |
---|---|
class |
FirstReducer<T>
Reducer that only emits the first N elements in a group.
|
class |
FormattingMapper<T>
Mapper that converts values to strings using a
TextOutputFormat.TextFormatter . |
class |
IdPartitioner
Partitioner that partitions by id.
|
class |
NullByteKeySelector<T>
Used as a dummy
KeySelector to allow using keyed operators for non-keyed use cases. |
class |
SampleInCoordinator<T>
SampleInCoordinator wraps the sample logic of the coordinator side (the second phase of
distributed sample algorithm).
|
class |
SampleInPartition<T>
SampleInPartition wraps the sample logic on the partition side (the first phase of distributed
sample algorithm).
|
class |
SampleWithFraction<T>
A map partition function wrapper for sampling algorithms with fraction, the sample algorithm
takes the partition iterator as input.
|
class |
SelectByMaxFunction<T extends Tuple>
Function that enables selection by maximal value of a field.
|
class |
SelectByMinFunction<T extends Tuple>
Function that enables selection by minimal value of a field.
|
class |
SemanticPropUtil
Utility class that contains helper methods to work with
SemanticProperties . |
Modifier and Type | Method and Description |
---|---|
static Set<Annotation> |
FunctionAnnotation.readDualForwardAnnotations(Class<?> udfClass)
Reads the annotations of a user defined function with two inputs and returns semantic
properties according to the forwarded fields annotated.
|
static Set<Annotation> |
FunctionAnnotation.readSingleForwardAnnotations(Class<?> udfClass)
Reads the annotations of a user defined function with one input and returns semantic
properties according to the forwarded fields annotated.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatCommonBase<T,SPITTYPE extends InputSplit>
A common base for both "mapred" and "mapreduce" Hadoop input formats.
|
class |
HadoopOutputFormatCommonBase<T>
A common base for both "mapred" and "mapreduce" Hadoop output formats.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatBase<K,V,T>
Common base for Java and Scala API for using Hadoop input formats with Flink.
|
class |
HadoopOutputFormatBase<K,V,T>
Common base for the mapred HadoopOutputFormat wrappers.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopUtils
Utility class to work with Apache Hadoop MapRed classes.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputSplit
A wrapper that represents an input split from the Hadoop mapred API as a Flink
InputSplit . |
Modifier and Type | Class and Description |
---|---|
class |
HadoopInputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink.
|
class |
HadoopOutputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
HadoopUtils
Utility class to work with next generation of Apache Hadoop MapReduce classes.
|
Modifier and Type | Class and Description |
---|---|
class |
BlockingShuffleOutputFormat<T>
This is the inner OutputFormat used for specify the BLOCKING_PERSISTENT result partition type of
coming edge.
|
class |
CsvInputFormat<OUT>
InputFormat that reads csv files.
|
class |
PojoCsvInputFormat<OUT>
Input format that reads csv into POJOs.
|
class |
TupleCsvInputFormat<OUT>
Input format that reads csv into tuples.
|
Modifier and Type | Class and Description |
---|---|
class |
BulkIterationResultSet<T>
Resulting
DataSet of bulk iterations. |
class |
CoGroupRawOperator<I1,I2,OUT>
A
DataSet that is the result of a CoGroup transformation. |
static class |
CrossOperator.CrossProjection<I1,I2> |
static class |
CrossOperator.ProjectCrossFunction<T1,T2,R extends Tuple> |
static class |
JoinOperator.DefaultJoin.WrappingFlatJoinFunction<IN1,IN2,OUT>
Wrapper around
JoinFunction . |
class |
KeyFunctions
This class holds static utilities to append functions that extract and prune keys.
|
class |
NoOpOperator<IN>
This operator will be ignored during translation.
|
class |
OperatorTranslation
Used for translating data sets into corresponding operators.
|
static class |
ProjectOperator.Projection<T>
A projection of
DataSet . |
Modifier and Type | Method and Description |
---|---|
Map<String,DataSet<?>> |
UdfOperator.getBroadcastSets()
Gets the broadcast sets (name and data set) that have been added to context of the UDF.
|
Map<String,DataSet<?>> |
SingleInputUdfOperator.getBroadcastSets() |
Map<String,DataSet<?>> |
TwoInputUdfOperator.getBroadcastSets() |
CrossOperatorBase.CrossHint |
CrossOperator.getCrossHint() |
Partitioner<?> |
PartitionOperator.getCustomPartitioner()
Gets the custom partitioner from this partitioning.
|
Partitioner<?> |
Grouping.getCustomPartitioner()
Gets the custom partitioner to be used for this grouping, or
null , if none was
defined. |
DataSet<T> |
DataSink.getDataSet() |
OutputFormat<T> |
DataSink.getFormat() |
DataSet<T> |
Grouping.getInputDataSet()
Returns the input DataSet of a grouping operation, that is the one before the grouping.
|
InputFormat<OUT,?> |
DataSource.getInputFormat()
Gets the input format that is executed by this data source.
|
JoinOperatorBase.JoinHint |
JoinOperator.getJoinHint()
Gets the JoinHint that describes how the join is executed.
|
JoinType |
JoinOperator.getJoinType()
Gets the JoinType that describes this join operation (e.g.
|
int[] |
DeltaIterationResultSet.getKeyPositions() |
Keys<T> |
Grouping.getKeys() |
protected Keys<I1> |
CoGroupOperator.getKeys1() |
protected Keys<I2> |
CoGroupOperator.getKeys2() |
int |
DeltaIterationResultSet.getMaxIterations() |
Partitioner<?> |
JoinOperator.getPartitioner()
Gets the custom partitioner used by this join, or
null , if none is set. |
SingleInputSemanticProperties |
GroupCombineOperator.getSemanticProperties() |
SemanticProperties |
UdfOperator.getSemanticProperties()
Gets the semantic properties that have been set for the user-defined functions (UDF).
|
SingleInputSemanticProperties |
SingleInputUdfOperator.getSemanticProperties() |
SingleInputSemanticProperties |
ReduceOperator.getSemanticProperties() |
SingleInputSemanticProperties |
GroupReduceOperator.getSemanticProperties() |
DualInputSemanticProperties |
TwoInputUdfOperator.getSemanticProperties() |
DualInputSemanticProperties |
JoinOperator.EquiJoin.getSemanticProperties() |
TypeInformation<T> |
DataSink.getType() |
boolean |
GroupReduceOperator.isCombinable() |
void |
TwoInputUdfOperator.setSemanticProperties(DualInputSemanticProperties properties)
Sets the semantic properties for the user-defined function (UDF).
|
void |
SingleInputUdfOperator.setSemanticProperties(SingleInputSemanticProperties properties)
Sets the semantic properties for the user-defined function (UDF).
|
protected CoGroupOperatorBase<?,?,OUT,?> |
CoGroupOperator.translateToDataFlow(Operator<I1> input1,
Operator<I2> input2) |
protected GroupReduceOperatorBase<IN,IN,GroupReduceFunction<IN,IN>> |
AggregateOperator.translateToDataFlow(Operator<IN> input) |
Modifier and Type | Class and Description |
---|---|
class |
CombineToGroupCombineWrapper<IN,OUT,F extends CombineFunction<IN,IN> & GroupReduceFunction<IN,OUT>>
A wrapper the wraps a function that implements both
CombineFunction and GroupReduceFunction interfaces and makes it look like a function that implements GroupCombineFunction and GroupReduceFunction to the runtime. |
class |
KeyExtractingMapper<T,K>
Mapper that extracts keys.
|
class |
KeyRemovingMapper<T,K>
Mapper that removes keys.
|
class |
PlanBothUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values.
|
class |
PlanFilterOperator<T> |
class |
PlanLeftUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values on the left.
|
class |
PlanProjectOperator<T,R extends Tuple>
A map operator that retains a subset of fields from incoming tuples.
|
class |
PlanRightUnwrappingCoGroupOperator<I1,I2,OUT,K>
A co group operator that applies the operation only on the unwrapped values on the right.
|
class |
PlanUnwrappingGroupCombineOperator<IN,OUT,K>
A group combine operator that takes 2-tuples (key-value pairs), and applies the group combine
operation only on the unwrapped values.
|
class |
PlanUnwrappingReduceGroupOperator<IN,OUT,K>
A reduce operator that takes 2-tuples (key-value pairs), and applies the group reduce operation
only on the unwrapped values.
|
class |
PlanUnwrappingReduceOperator<T,K>
A reduce operator that takes 2-tuples (key-value pairs), and applies the reduce operation only on
the unwrapped values.
|
class |
PlanUnwrappingSortedGroupCombineOperator<IN,OUT,K1,K2>
A reduce operator that takes 3-tuples (groupKey, sortKey, value), and applies the sorted partial
group reduce operation only on the unwrapped values.
|
class |
PlanUnwrappingSortedReduceGroupOperator<IN,OUT,K1,K2>
A reduce operator that takes 3-tuples (groupKey, sortKey, value), and applies the sorted group
reduce operation only on the unwrapped values.
|
class |
Tuple3UnwrappingIterator<T,K1,K2>
An iterator that reads 3-tuples (groupKey, sortKey, value) and returns only the values (third
field).
|
class |
Tuple3WrappingCollector<IN,K1,K2>
Needed to wrap tuples to
Tuple3<groupKey, sortKey, value> for combine method of group
reduce with key selector sorting. |
class |
TupleLeftUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps values from the left set before applying the join operation.
|
class |
TupleRightUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps values from the right set before applying the join operation.
|
class |
TupleUnwrappingIterator<T,K>
An iterator that reads 2-tuples (key value pairs) and returns only the values (second field).
|
class |
TupleUnwrappingJoiner<I1,I2,OUT,K>
Joiner that unwraps both values before applying the join operation.
|
class |
TupleWrappingCollector<IN,K>
Needed to wrap tuples to
Tuple2<key, value> pairs for combine method of group reduce with
key selector function. |
class |
TwoKeyExtractingMapper<T,K1,K2>
Mapper that extracts two keys of a value.
|
class |
WrappingFunction<T extends Function>
Wrapper around
Function . |
Modifier and Type | Class and Description |
---|---|
class |
BernoulliSampler<T>
A sampler implementation built upon a Bernoulli trail.
|
class |
DistributedRandomSampler<T>
For sampling with fraction, the sample algorithms are natively distributed, while it's not true
for fixed size sample algorithms.
|
class |
IntermediateSampleData<T>
The data structure which is transferred between partitions and the coordinator for distributed
random sampling.
|
class |
PoissonSampler<T>
A sampler implementation based on the Poisson Distribution.
|
class |
RandomSampler<T>
A data sample is a set of data selected from a statistical population by a defined procedure.
|
class |
ReservoirSamplerWithoutReplacement<T>
A simple in memory implementation of Reservoir Sampling without replacement, and with only one
pass through the input iteration whose size is unpredictable.
|
class |
ReservoirSamplerWithReplacement<T>
A simple in memory implementation of Reservoir Sampling with replacement and with only one pass
through the input iteration whose size is unpredictable.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Aggregator<T,R>
Generic interface for aggregation.
|
class |
BooleanSummaryAggregator
Aggregator for
Boolean type. |
class |
CompensatedSum
Used to calculate sums using the Kahan summation algorithm.
|
class |
DoubleSummaryAggregator
Aggregator that can handle Double types.
|
class |
FloatSummaryAggregator
Aggregator that can handle Float types.
|
class |
IntegerSummaryAggregator
Aggregator that can handle Integer types.
|
class |
LongSummaryAggregator
Aggregator that can handle Long types.
|
class |
NumericSummaryAggregator<T extends Number>
Generic aggregator for all numeric types creates a summary of a column of numbers.
|
class |
ObjectSummaryAggregator
Aggregator that calculates statistics for Object values. |
class |
ShortSummaryAggregator
Aggregator that can handle Short types.
|
class |
StringSummaryAggregator
Aggregator that calculates statistics for String values. |
class |
SummaryAggregatorFactory
Factory for creating Summary Aggregators.
|
class |
TupleSummaryAggregator<R extends Tuple>
Aggregate tuples using an array of aggregators, one for each "column" or position within the
Tuple.
|
class |
ValueSummaryAggregator<VT extends Value,PT,R,A extends Aggregator<PT,R>>
This is a generic Aggregator for Value types like StringValue, DoubleValue, etc.
|
Modifier and Type | Class and Description |
---|---|
class |
PojoField
Represent a field definition for
PojoTypeInfo type of objects. |
class |
TypeExtractionException
Type extraction always contains some uncertainty due to unpredictable JVM differences between
vendors or versions.
|
class |
TypeExtractionUtils |
Modifier and Type | Method and Description |
---|---|
static <OUT> TypeInfoFactory<OUT> |
TypeExtractor.getTypeInfoFactory(Field field)
Returns the type information factory for an annotated field.
|
static <OUT> TypeInfoFactory<OUT> |
TypeExtractor.getTypeInfoFactory(Type t)
Returns the type information factory for a type using the factory registry or annotations.
|
Modifier and Type | Class and Description |
---|---|
class |
CopyableValueComparator<T extends CopyableValue<T> & Comparable<T>>
Comparator for all Value types that extend Key
|
class |
CopyableValueSerializer<T extends CopyableValue<T>> |
class |
DataInputViewStream
An input stream that draws its data from a
DataInputView . |
class |
DataOutputViewStream |
class |
EitherSerializer<L,R>
A
TypeSerializer for the Either type of the Java class. |
class |
EitherSerializerConfigSnapshot<L,R>
Deprecated.
|
class |
EitherSerializerSnapshot<L,R>
Deprecated.
this snapshot class is no longer used by any serializers. Instead,
JavaEitherSerializerSnapshot is used. |
class |
FieldSerializer
This class is for the serialization of java.lang.reflect.Field, which doesn't implement
Serializable, therefore readObject/writeObject need to be implemented in classes where there is a
field of type java.lang.reflect.Field.
|
class |
GenericTypeComparator<T extends Comparable<T>>
TypeComparator for all types that extend Comparable.
|
class |
KryoRegistration
A
KryoRegistration resembles a registered class and its serializer in Kryo. |
class |
KryoRegistrationSerializerConfigSnapshot<T>
Configuration snapshot base class for serializers that use Kryo for serialization.
|
class |
KryoUtils
Convenience methods for Kryo
|
class |
MaskUtils
Utilities for reading and writing binary masks.
|
class |
NoFetchingInput |
static class |
NullableSerializer.NullableSerializerConfigSnapshot<T>
Deprecated.
this snapshot class is no longer in use, and is maintained only for backwards
compatibility purposes. It is fully replaced by
NullableSerializer.NullableSerializerSnapshot . |
class |
NullAwareComparator<T>
Null-aware comparator that wraps a comparator which does not support null references.
|
class |
PojoComparator<T> |
class |
PojoSerializer<T> |
class |
PojoSerializerSnapshot<T>
Snapshot class for the
PojoSerializer . |
class |
RowComparator
Comparator for
Row . |
class |
RowSerializer
Serializer for
Row . |
class |
RuntimeComparatorFactory<T> |
class |
RuntimePairComparatorFactory<T1,T2> |
class |
RuntimeSerializerFactory<T> |
class |
Tuple0Serializer |
class |
TupleComparator<T extends Tuple> |
class |
TupleComparatorBase<T> |
class |
TupleSerializer<T extends Tuple> |
class |
TupleSerializerBase<T> |
class |
TupleSerializerConfigSnapshot<T>
Snapshot of a tuple serializer's configuration.
|
class |
TupleSerializerSnapshot<T extends Tuple>
Snapshot of a tuple serializer's configuration.
|
class |
ValueComparator<T extends Value & Comparable<T>>
Comparator for all Value types that extend Key
|
class |
ValueSerializer<T extends Value>
Serializer for
Value types. |
class |
WritableSerializer<T extends org.apache.hadoop.io.Writable>
A
TypeSerializer for Writable . |
Modifier and Type | Class and Description |
---|---|
class |
Serializers
Class containing utilities for the serializers of the Flink Runtime.
|
Modifier and Type | Class and Description |
---|---|
class |
PlanGenerator
|
Modifier and Type | Class and Description |
---|---|
class |
ScalaCaseClassSerializerSnapshot<T extends scala.Product>
TypeSerializerSnapshot for ScalaCaseClassSerializer . |
class |
Tuple2CaseClassSerializerSnapshot<T1,T2>
TypeSerializerSnapshot for ScalaCaseClassSerializer . |
Modifier and Type | Class and Description |
---|---|
static class |
PatternStream.CoMapTimeout<R,L>
Used for joining results from timeout side-output for API backward compatibility.
|
Modifier and Type | Class and Description |
---|---|
class |
PatternFlatSelectAdapter<IN,OUT>
Adapter that expresses
PatternFlatSelectFunction with PatternProcessFunction . |
class |
PatternSelectAdapter<IN,OUT>
Adapter that expresses
PatternSelectFunction with PatternProcessFunction . |
class |
PatternTimeoutFlatSelectAdapter<IN,OUT,T>
Adapter that expresses combination of
PatternFlatSelectFunction and PatternTimeoutFlatSelectAdapter with PatternProcessFunction . |
class |
PatternTimeoutSelectAdapter<IN,OUT,T>
Adapter that expresses combination of
PatternSelectFunction and PatternTimeoutFlatSelectAdapter with PatternProcessFunction . |
Modifier and Type | Class and Description |
---|---|
class |
LockableTypeSerializerSnapshot<E>
|
Modifier and Type | Class and Description |
---|---|
class |
CepOperator<IN,KEY,OUT>
CEP pattern operator for a keyed input stream.
|
Modifier and Type | Class and Description |
---|---|
class |
AndCondition<T>
Deprecated.
Please use
RichAndCondition instead. This class exists just for backwards
compatibility and will be removed in FLINK-10113. |
class |
BooleanConditions
Utility class containing an
IterativeCondition that always returns true and one
that always returns false . |
class |
NotCondition<T>
Deprecated.
Please use
RichNotCondition instead. This class exists just for backwards
compatibility and will be removed in FLINK-10113. |
class |
OrCondition<T>
Deprecated.
Please use
RichOrCondition instead. This class exists just for backwards
compatibility and will be removed in FLINK-10113. |
class |
RichAndCondition<T>
|
class |
RichNotCondition<T>
A
condition which negates the condition it wraps and returns
true if the original condition returns false . |
class |
RichOrCondition<T>
A
condition which combines two conditions with a logical OR and returns true if at least one is true . |
class |
SimpleCondition<T>
A user-defined condition that decides if an element should be accepted in the pattern or not.
|
class |
SubtypeCondition<T>
A
condition which filters elements of the given type. |
Modifier and Type | Interface and Description |
---|---|
interface |
TimerService
Enables to provide time characteristic to
NFA for use in IterativeCondition . |
Modifier and Type | Class and Description |
---|---|
class |
FsStateChangelogStorageFactory
FsStateChangelogStorage factory. |
interface |
RetryPolicy
Retry policy to use by
RetryingExecutor . |
class |
StateChangeFormat
Serialization format for state changes.
|
class |
StateChangeSet
A set of changes made to some state(s) by a single state backend during a single checkpoint.
|
interface |
StateChangeUploader
The purpose of this interface is to abstract the different implementations of uploading state
changelog parts.
|
interface |
StateChangeUploadScheduler
Schedules
upload tasks on a StateChangeUploader . |
interface |
TaskChangelogRegistry
TM-side registry of
StateObjects , each
representing one or more changelog segments. |
class |
UploadResult
Result of uploading state changes.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ApplicationDeployer
An interface to be used by the
CliFrontend to submit user programs for execution. |
class |
ExecutionConfigAccessor
Accessor that exposes config settings that are relevant for execution from an underlying
Configuration . |
class |
GenericCLI
A generic implementation of the
CustomCommandLine that only expects the execution.target
parameter to be explicitly specified and simply forwards the rest of the options specified with
-D to the corresponding PipelineExecutor for further parsing. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractContainerizedClusterClientFactory<ClusterID>
An abstract
ClusterClientFactory containing some common implementations for different
containerized deployment clusters. |
interface |
ClusterClientFactory<ClusterID>
A factory containing all the necessary information for creating clients to Flink clusters.
|
class |
DefaultClusterClientServiceLoader
A service provider for
cluster client factories . |
class |
StandaloneClientFactory
A
ClusterClientFactory for a standalone cluster, i.e. |
Modifier and Type | Class and Description |
---|---|
class |
ApplicationConfiguration
Application-specific configurations.
|
class |
ApplicationDispatcherBootstrap
A
DispatcherBootstrap used for running the user's main() in "Application Mode"
(see FLIP-85). |
class |
ApplicationDispatcherGatewayServiceFactory
A
DispatcherGatewayServiceFactory used when executing a job in Application Mode, i.e. |
class |
ApplicationDispatcherLeaderProcessFactoryFactory
Factory for a
DispatcherLeaderProcessFactoryFactory designed to be used when executing an
application in Application Mode. |
interface |
ApplicationRunner
An interface to be implemented by the entities responsible for application submission for the
different deployment environments.
|
class |
DetachedApplicationRunner
An
ApplicationRunner which runs the user specified application using the EmbeddedExecutor . |
class |
EmbeddedJobClient
A
JobClient with the ability to also submit jobs which uses directly the DispatcherGateway . |
class |
UnsuccessfulExecutionException
Exception that signals the failure of an application with a given
ApplicationStatus . |
Modifier and Type | Class and Description |
---|---|
class |
ApplicationClusterDeployer
An entity responsible for submitting an application for execution in "Application Mode", i.e.
|
Modifier and Type | Class and Description |
---|---|
class |
EmbeddedExecutor
A base class for
executors that invoke directly methods of the Dispatcher and do not go through the REST
API. |
class |
EmbeddedExecutorFactory
An
PipelineExecutorFactory for the EmbeddedExecutor . |
class |
EmbeddedExecutorServiceLoader
A
PipelineExecutorServiceLoader that always returns an EmbeddedExecutorFactory . |
interface |
EmbeddedJobClientCreator
An interface to be implemented by
JobClient suppliers. |
class |
WebSubmissionExecutorFactory
|
class |
WebSubmissionExecutorServiceLoader
A
PipelineExecutorServiceLoader that always returns an WebSubmissionExecutorFactory . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractJobClusterExecutor<ClusterID,ClientFactory extends ClusterClientFactory<ClusterID>>
Deprecated.
|
class |
AbstractSessionClusterExecutor<ClusterID,ClientFactory extends ClusterClientFactory<ClusterID>>
An abstract
PipelineExecutor used to execute pipelines on an existing
(session) cluster. |
class |
LocalExecutor
An
PipelineExecutor for executing a Pipeline locally. |
class |
LocalExecutorFactory
|
class |
RemoteExecutor
The
PipelineExecutor to be used when executing a job on an already running cluster. |
class |
RemoteExecutorFactory
|
Modifier and Type | Interface and Description |
---|---|
interface |
ClusterClientProvider<T>
Factory for
ClusterClients . |
class |
MutatedConfigurationException
If
DeploymentOptions.PROGRAM_CONFIG_ENABLED is disabled, configurations in the user jar
will throw this exception. |
interface |
PackagedProgramRetriever
Interface which allows to retrieve the
PackagedProgram . |
Constructor and Description |
---|
StreamContextEnvironment(PipelineExecutorServiceLoader executorServiceLoader,
Configuration clusterConfiguration,
Configuration configuration,
ClassLoader userCodeClassLoader,
boolean enforceSingleJobExecution,
boolean suppressSysout,
boolean programConfigEnabled,
Collection<String> programConfigWildcards) |
Modifier and Type | Class and Description |
---|---|
class |
ConfigUtils
General utilities for parsing values to configuration options.
|
class |
DeploymentOptionsInternal
Internal options used during deployment.
|
class |
GlobalConfiguration
Global configuration object for Flink.
|
class |
PipelineOptionsInternal
Pipeline options that are not meant to be used by the user.
|
class |
RestOptions
Configuration parameters for REST communication.
|
class |
StateChangelogOptionsInternal
StateChangelog options that are used to pass job-level configuration from JM to TM.
|
class |
TaskManagerOptionsInternal
TaskManager options that are not meant to be used by the user.
|
Modifier and Type | Field and Description |
---|---|
static ConfigOption<Boolean> |
AkkaOptions.FORCE_RPC_INVOCATION_SERIALIZATION |
static String[] |
CoreOptions.PARENT_FIRST_LOGGING_PATTERNS |
Modifier and Type | Method and Description |
---|---|
static String[] |
CoreOptions.mergeListsToArray(List<String> base,
List<String> append) |
Modifier and Type | Class and Description |
---|---|
class |
AWSAsyncSinkUtil
Some utilities specific to Amazon Web Service.
|
class |
AWSAuthenticationException
Exception thrown on failure of authentication of Aws Credentials, this includes missing
configuration, illegal access and unreachable endpoints.
|
class |
AWSCredentialFatalExceptionClassifiers
Class containing set of
FatalExceptionClassifier for AWS credential failures. |
class |
AWSGeneralUtil
Some general utilities specific to Amazon Web Service.
|
Modifier and Type | Class and Description |
---|---|
class |
FatalExceptionClassifier
Classifier class for retryable exceptions on request submission failure.
|
Modifier and Type | Class and Description |
---|---|
class |
AsyncSinkFatalExceptionClassifiers
Common retry exception classifiers needed for common errors.
|
Modifier and Type | Class and Description |
---|---|
class |
BasicRequestInfo
Dataclass to encapsulate information about starting requests.
|
class |
BasicResultInfo
Dataclass to encapsulate results from completed requests.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState> |
HybridSource.createEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext) |
SourceReader<T,HybridSourceSplit> |
HybridSource.createReader(SourceReaderContext readerContext) |
SimpleVersionedSerializer<HybridSourceEnumeratorState> |
HybridSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<HybridSourceSplit> |
HybridSource.getSplitSerializer() |
SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState> |
HybridSource.restoreEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext,
HybridSourceEnumeratorState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
SingleThreadFetcherManager<E,SplitT extends SourceSplit>
A Fetcher Manager with a single fetching thread (I/O thread) that handles all splits
concurrently.
|
class |
SplitFetcher<E,SplitT extends SourceSplit>
The internal fetcher runnable responsible for polling message from the external system.
|
class |
SplitFetcherManager<E,SplitT extends SourceSplit>
A class responsible for starting the
SplitFetcher and manage the life cycles of them. |
interface |
SplitFetcherTask
An interface similar to
Runnable but allows throwing exceptions and wakeup. |
Modifier and Type | Class and Description |
---|---|
class |
FutureCompletingBlockingQueue<T>
A custom implementation of blocking queue in combination with a
CompletableFuture that is
used in the hand-over of data from a producing thread to a consuming thread. |
Modifier and Type | Class and Description |
---|---|
class |
SerdeUtils
A util class with some helper method for serde in the sources.
|
Modifier and Type | Class and Description |
---|---|
class |
AsyncDynamicTableSinkFactory.AsyncDynamicSinkContext
Class providing common table data required by
AsyncDynamicTableSinkFactory to create
AsyncDynamicTableSink . |
Modifier and Type | Class and Description |
---|---|
class |
BlackHoleTableSinkFactory
Black hole table sink factory swallowing all input records.
|
Modifier and Type | Class and Description |
---|---|
class |
DataGenConnectorOptionsUtil
Utilities for
DataGenConnectorOptions . |
class |
DataGeneratorContainer
Container class for wrapping a
with its configuration options . |
class |
DataGenTableSource
A
StreamTableSource that emits each number from a given interval exactly once, possibly
in parallel. |
class |
DataGenTableSourceFactory
Factory for creating configured instances of
DataGenTableSource in a stream environment. |
class |
DataGenVisitorBase
Base class for translating
LogicalTypes to DataGeneratorContainer 's. |
class |
RandomGeneratorVisitor
Creates a random
DataGeneratorContainer for a particular logical type. |
class |
SequenceGeneratorVisitor
Creates a sequential
DataGeneratorContainer for a particular logical type. |
Modifier and Type | Class and Description |
---|---|
class |
DataGeneratorMapper<A,B>
Utility for mapping the output of a
DataGenerator . |
class |
DecimalDataRandomGenerator
Generates random
DecimalData values. |
class |
RowDataGenerator
Data generator for Flink's internal
RowData type. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch6DynamicSinkFactory
A
DynamicTableSinkFactory for discovering ElasticsearchDynamicSink . |
class |
Elasticsearch7DynamicSinkFactory
A
DynamicTableSinkFactory for discovering ElasticsearchDynamicSink . |
class |
IndexGeneratorBase
Base class for
IndexGenerator . |
Modifier and Type | Class and Description |
---|---|
class |
FileSinkCommittable
Wrapper class for both type of committables in
FileSink . |
class |
FileSinkCommittableSerializer
Versioned serializer for
FileSinkCommittable . |
Modifier and Type | Class and Description |
---|---|
class |
FileCommitter
Committer implementation for
FileSink . |
Modifier and Type | Class and Description |
---|---|
class |
IdenticalFileCompactor
A simple
OutputStreamBasedFileCompactor implementation that directly copy the content of
the only input file to the output. |
Modifier and Type | Class and Description |
---|---|
class |
CompactCoordinator
Coordinator that coordinates file compaction for the
FileSink . |
class |
CompactCoordinatorFactory
Factory for
CompactCoordinator . |
class |
CompactCoordinatorStateHandlerFactory
Factory for
CompactCoordinatorStateHandler . |
class |
CompactorOperator
An operator that perform compaction for the
FileSink . |
class |
CompactorOperatorFactory
Factory for
CompactorOperator . |
class |
CompactorOperatorStateHandler
Handler that processes the state of
CompactorOperator when compaction is disabled. |
class |
CompactorOperatorStateHandlerFactory
Factory for
CompactorOperatorStateHandler . |
class |
CompactorRequest
Request of file compacting for
FileSink . |
class |
CompactorRequestSerializer
Versioned serializer for
CompactorRequest . |
class |
CompactorRequestTypeInfo
Type information of
CompactorRequest . |
class |
CompactService
The asynchronous file compaction service.
|
Modifier and Type | Class and Description |
---|---|
class |
DefaultFileWriterBucketFactory<IN>
A factory returning
writer . |
class |
FileWriter<IN>
A
SinkWriter implementation for FileSink . |
interface |
FileWriterBucketFactory<IN>
A factory able to create
FileWriterBucket for the FileSink . |
class |
FileWriterBucketState
States for
FileWriterBucket . |
class |
FileWriterBucketStateSerializer
A
SimpleVersionedSerializer used to serialize the BucketState . |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousEnumerationSettings
Settings describing how to do continuous file discovery and enumeration for the file source's
continuous discovery and streaming mode.
|
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileSplitEnumerator
A continuously monitoring enumerator.
|
class |
DynamicFileSplitEnumerator<SplitT extends FileSourceSplit>
A SplitEnumerator implementation that supports dynamic filtering.
|
class |
FileRecordFormatAdapter<T>
Deprecated.
Please use
StreamFormatAdapter instead. |
class |
FileRecords<T>
A collection of records for one file split.
|
class |
FileSourceReader<T,SplitT extends FileSourceSplit>
A
SourceReader that read records from FileSourceSplit . |
class |
StaticFileSplitEnumerator
A SplitEnumerator implementation for bounded / batch
FileSource input. |
class |
StreamFormatAdapter<T>
Adapter to turn a
StreamFormat into a BulkFormat . |
Modifier and Type | Class and Description |
---|---|
class |
RecyclableIterator<E>
Utility base class for iterators that accept a recycler.
|
Modifier and Type | Class and Description |
---|---|
class |
BinPacking
A bin packing implementation.
|
class |
ColumnarRowIterator
A
BulkFormat.RecordIterator that returns RowData s. |
interface |
ContinuousPartitionFetcher<P,T extends Comparable<T>>
Partition fetcher for helping continuously fetch partitioned table.
|
class |
DefaultPartTimeExtractor
Default
PartitionTimeExtractor . |
class |
DeserializationSchemaAdapter
Adapter to turn a
DeserializationSchema into a BulkFormat . |
class |
DynamicPartitionWriter<T>
Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more
memory.
|
class |
EmptyMetaStoreFactory
Empty implementation
TableMetaStoreFactory . |
class |
EnrichedRowData
|
interface |
FileSystemFactory
A factory to create file systems.
|
class |
FileSystemOutputFormat<T>
File system
OutputFormat for batch job. |
class |
FileSystemTableFactory
File system
TableFactory . |
class |
FileSystemTableSink
File system
DynamicTableSink . |
class |
FileSystemTableSource
File system table source.
|
class |
GroupedPartitionWriter<T>
PartitionWriter for grouped dynamic partition inserting. |
class |
LimitableBulkFormat<T,SplitT extends FileSourceSplit>
A
BulkFormat that can limit output record number. |
class |
MetastoreCommitPolicy
Partition commit policy to update metastore.
|
interface |
OutputFormatFactory<T>
A factory to create an
OutputFormat . |
class |
PartitionCommitPolicyFactory
A factory to create
PartitionCommitPolicy chain. |
interface |
PartitionComputer<T>
Compute partition path from record and project non-partition columns for output writer.
|
interface |
PartitionFetcher<P>
Fetcher to fetch the suitable partitions of a filesystem table.
|
interface |
PartitionFieldExtractor<T extends FileSourceSplit>
Interface to extract partition field from split.
|
class |
PartitionLoader
Loader to temporary files to final output path and meta store.
|
interface |
PartitionReader<P,OUT>
Reader that reads record from given partitions.
|
class |
PartitionTempFileManager
Manage temporary files for writing files.
|
interface |
PartitionWriter<T>
Partition writer to write records with partition.
|
interface |
PartitionWriterFactory<T>
Factory of
PartitionWriter to avoid virtual function calls. |
class |
RowDataPartitionComputer
PartitionComputer for RowData . |
class |
RowPartitionComputer
PartitionComputer for Row . |
class |
SerializationSchemaAdapter
Adapter to turn a
SerializationSchema into a Encoder . |
class |
SingleDirectoryWriter<T>
PartitionWriter for single directory writer. |
class |
SuccessFileCommitPolicy
Partition commit policy to add success file to directory.
|
interface |
TableMetaStoreFactory
Meta store factory to create
TableMetaStoreFactory.TableMetaStore . |
Modifier and Type | Interface and Description |
---|---|
interface |
BulkReaderFormatFactory
Base interface for configuring a
BulkFormat for file system connector. |
interface |
BulkWriterFormatFactory
Base interface for configuring a
BulkWriter.Factory for file system connector. |
Modifier and Type | Interface and Description |
---|---|
interface |
BulkDecodingFormat<T>
|
Modifier and Type | Class and Description |
---|---|
class |
PartitionCommitInfo
The message sent by upstream.
|
interface |
PartitionCommitPredicate
Partition commit predicate.
|
class |
PartitionCommitter
Committer operator for partitions.
|
interface |
PartitionCommitTrigger
Partition commit trigger.
|
class |
PartitionTimeCommitPredicate
Partition commit predicate by partition time and watermark, if 'watermark' > 'partition-time' +
'delay', the partition is committable.
|
class |
PartitionTimeCommitTrigger
Partition commit trigger by partition time and watermark.
|
class |
ProcTimeCommitPredicate
Partition commit trigger by creation time and processing time service, if 'current processing
time' > 'partition creation time' + 'delay', the partition is committable.
|
class |
ProcTimeCommitTrigger
Partition commit trigger by creation time and processing time service.
|
class |
StreamingFileWriter<IN>
Writer for emitting
PartitionCommitInfo to downstream. |
class |
StreamingSink
Helper for creating streaming file sink.
|
class |
TaskTracker
Track the upstream tasks to determine whether all the upstream data of a checkpoint has been
received.
|
Modifier and Type | Class and Description |
---|---|
class |
CompactBucketWriter<T>
The
CompactWriter to delegate BucketWriter . |
class |
CompactBulkReader<T>
The
CompactReader to delegate CompactBulkReader . |
interface |
CompactContext
Context for
CompactReader and CompactWriter . |
class |
CompactCoordinator
This is the single (non-parallel) monitoring task which coordinate input files to compaction
units.
|
class |
CompactFileWriter<T>
Writer for emitting
CompactMessages.InputFile and CompactMessages.EndCheckpoint to downstream. |
class |
CompactMessages
Util class for all compaction messages.
|
class |
CompactOperator<T>
Receives compaction units to do compaction.
|
interface |
CompactReader<T>
Reader for compaction.
|
interface |
CompactWriter<T>
Writer for compaction.
|
class |
FileInputFormatCompactReader<T>
The
CompactReader to delegate FileInputFormat . |
Modifier and Type | Class and Description |
---|---|
class |
KinesisFirehoseSinkElementConverter<InputT>
An implementation of the
ElementConverter that uses the AWS Kinesis SDK v2. |
class |
KinesisFirehoseStateSerializer
Kinesis Firehose implementation
AsyncSinkWriterStateSerializer . |
Modifier and Type | Class and Description |
---|---|
class |
KinesisFirehoseDynamicSink
Kinesis firehose backed
AsyncDynamicTableSink . |
static class |
KinesisFirehoseDynamicSink.KinesisFirehoseDynamicSinkBuilder
Builder class for
KinesisFirehoseDynamicSink . |
class |
KinesisFirehoseDynamicTableFactory
Factory for creating
KinesisFirehoseDynamicSink . |
Modifier and Type | Class and Description |
---|---|
class |
KinesisFirehoseConnectorOptionUtils
Class for extracting firehose configurations from table options.
|
Modifier and Type | Class and Description |
---|---|
class |
HBaseWriteOptions
Options for HBase writing.
|
Modifier and Type | Interface and Description |
---|---|
interface |
HBaseMutationConverter<T>
A converter used to converts the input record into HBase
Mutation . |
class |
HBaseSinkFunction<T>
The sink function for HBase.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractHBaseDynamicTableSource
HBase table source implementation.
|
class |
HBaseRowDataLookupFunction
The HBaseRowDataLookupFunction is a standard user-defined table function, it can be used in
tableAPI and also useful for temporal table join plan in SQL.
|
class |
TableInputSplit
This class implements a input splits for HBase.
|
Modifier and Type | Class and Description |
---|---|
class |
HBaseConnectorOptionsUtil
Utilities for
HBaseConnectorOptions . |
Modifier and Type | Class and Description |
---|---|
class |
HBaseConfigurationUtil
This class helps to do serialization for hadoop Configuration and HBase-related classes.
|
class |
HBaseTableSchema
Helps to specify an HBase Table's schema.
|
class |
HBaseTypeUtils
A utility class to process data exchange with HBase type system.
|
Modifier and Type | Class and Description |
---|---|
class |
HBase1DynamicTableFactory
HBase connector factory.
|
Modifier and Type | Class and Description |
---|---|
class |
HBaseDynamicTableSink
HBase table sink implementation.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractTableInputFormat<T>
Abstract
InputFormat to read data from HBase tables. |
class |
HBaseDynamicTableSource
HBase table source implementation.
|
Modifier and Type | Class and Description |
---|---|
class |
HBase2DynamicTableFactory
HBase connector factory.
|
Modifier and Type | Class and Description |
---|---|
class |
HBaseDynamicTableSink
HBase table sink implementation.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractTableInputFormat<T>
Abstract
InputFormat to read data from HBase tables. |
class |
HBaseDynamicTableSource
HBase table source implementation.
|
class |
HBaseRowDataAsyncLookupFunction
The HBaseRowDataAsyncLookupFunction is an implementation to lookup HBase data by rowkey in async
fashion.
|
Modifier and Type | Class and Description |
---|---|
class |
MySqlCatalog
Catalog for MySQL.
|
class |
PostgresCatalog
Catalog for PostgreSQL.
|
Modifier and Type | Class and Description |
---|---|
class |
JdbcCatalogFactoryOptions
ConfigOption s for JdbcCatalog . |
Modifier and Type | Class and Description |
---|---|
class |
JdbcDialectLoader
Utility for working with
JdbcDialect . |
Modifier and Type | Class and Description |
---|---|
class |
DerbyDialectFactory
Factory for
DerbyDialect . |
Modifier and Type | Class and Description |
---|---|
class |
MySqlDialect
JDBC dialect for MySQL.
|
class |
MySqlDialectFactory
Factory for
MySqlDialect . |
class |
MySqlTypeMapper
MySQLTypeMapper util class.
|
Modifier and Type | Class and Description |
---|---|
class |
OracleDialectFactory
Factory for
OracleDialect . |
Modifier and Type | Class and Description |
---|---|
class |
PostgresDialectFactory
Factory for
PostgresDialect . |
class |
PostgresTypeMapper
PostgresTypeMapper util class.
|
Modifier and Type | Class and Description |
---|---|
class |
GenericJdbcSinkFunction<T>
A generic SinkFunction for JDBC.
|
class |
JdbcOutputFormat<In,JdbcIn,JdbcExec extends JdbcBatchStatementExecutor<JdbcIn>>
A JDBC outputFormat that supports batching records before writing records to database.
|
Modifier and Type | Interface and Description |
---|---|
interface |
JdbcConnectionProvider
JDBC connection provider.
|
Modifier and Type | Class and Description |
---|---|
class |
InsertOrUpdateJdbcExecutor<R,K,V>
Deprecated.
This has been replaced with
TableInsertOrUpdateStatementExecutor |
interface |
JdbcBatchStatementExecutor<T>
Executes the given JDBC statement in batch for the accumulated records.
|
class |
TableInsertOrUpdateStatementExecutor
JdbcBatchStatementExecutor that provides upsert semantics by updating row if it exists
and inserting otherwise. |
Modifier and Type | Class and Description |
---|---|
class |
JdbcConnectorOptions
Options for the JDBC connector.
|
Modifier and Type | Class and Description |
---|---|
class |
JdbcDynamicTableFactory
Factory for creating configured instances of
JdbcDynamicTableSource and JdbcDynamicTableSink . |
class |
JdbcDynamicTableSink
A
DynamicTableSink for JDBC. |
class |
JdbcDynamicTableSource
A
DynamicTableSource for JDBC. |
class |
JdbcRowDataInputFormat
InputFormat for
JdbcDynamicTableSource . |
class |
JdbcRowDataLookupFunction
A lookup function for
JdbcDynamicTableSource . |
Modifier and Type | Class and Description |
---|---|
class |
JdbcTypeUtil
Utils for jdbc type.
|
Modifier and Type | Class and Description |
---|---|
class |
CheckpointAndXid
A pair of checkpoint id and
Xid representing a checkpoint and an associated pending
(prepared) XA transaction. |
class |
CheckpointAndXidSerializer
CheckpointAndXid serializer. |
class |
JdbcXaSinkFunction<T>
JDBC sink function that uses XA transactions to provide exactly once guarantees.
|
interface |
XaFacade
Facade to the XA operations relevant to
sink . |
class |
XaSinkStateSerializer
XaSinkStateSerializer.
|
interface |
XidGenerator
Xid generator. |
class |
XidSerializer
Xid serializer. |
Modifier and Type | Class and Description |
---|---|
class |
MetricUtil
Collection of methods to interact with Kafka's client metric system.
|
Modifier and Type | Interface and Description |
---|---|
static interface |
KafkaRecordSerializationSchema.KafkaSinkContext
Context providing information of the kafka record target location.
|
Modifier and Type | Method and Description |
---|---|
Committer<org.apache.flink.connector.kafka.sink.KafkaCommittable> |
KafkaSink.createCommitter() |
org.apache.flink.connector.kafka.sink.KafkaWriter<IN> |
KafkaSink.createWriter(Sink.InitContext context) |
SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaCommittable> |
KafkaSink.getCommittableSerializer() |
SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaWriterState> |
KafkaSink.getWriterStateSerializer() |
org.apache.flink.connector.kafka.sink.KafkaWriter<IN> |
KafkaSink.restoreWriter(Sink.InitContext context,
Collection<org.apache.flink.connector.kafka.sink.KafkaWriterState> recoveredState) |
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceOptions
Configurations for KafkaSource.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.createEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext) |
SourceReader<OUT,KafkaPartitionSplit> |
KafkaSource.createReader(SourceReaderContext readerContext) |
SimpleVersionedSerializer<KafkaSourceEnumState> |
KafkaSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<KafkaPartitionSplit> |
KafkaSource.getSplitSerializer() |
SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> |
KafkaSource.restoreEnumerator(SplitEnumeratorContext<KafkaPartitionSplit> enumContext,
KafkaSourceEnumState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceEnumerator
The enumerator class for Kafka source.
|
class |
KafkaSourceEnumState
The state of Kafka source enumerator.
|
class |
KafkaSourceEnumStateSerializer
The
Serializer for the enumerator
state of Kafka source. |
Modifier and Type | Class and Description |
---|---|
class |
NoStoppingOffsetsInitializer
An implementation of
OffsetsInitializer which does not initialize anything. |
interface |
OffsetsInitializerValidator
Interface for validating
OffsetsInitializer with properties from KafkaSource . |
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplitReader
A
SplitReader implementation that reads records from Kafka partitions. |
class |
KafkaRecordEmitter<T>
The
RecordEmitter implementation for KafkaSourceReader . |
class |
KafkaSourceReader<T>
The source reader for Kafka partitions.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaSourceFetcherManager
The SplitFetcherManager for Kafka source.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaPartitionSplit
A
SourceSplit for a Kafka partition. |
class |
KafkaPartitionSplitSerializer
The
serializer for KafkaPartitionSplit . |
class |
KafkaPartitionSplitState
This class extends KafkaPartitionSplit to track a mutable current offset.
|
Modifier and Type | Class and Description |
---|---|
class |
KinesisStreamsSinkElementConverter<InputT>
An implementation of the
ElementConverter that uses the AWS Kinesis SDK v2. |
class |
KinesisStreamsStateSerializer
Kinesis Streams implementation
AsyncSinkWriterStateSerializer . |
Modifier and Type | Method and Description |
---|---|
StatefulSink.StatefulSinkWriter<InputT,BufferedRequestState<software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry>> |
KinesisStreamsSink.createWriter(Sink.InitContext context) |
SimpleVersionedSerializer<BufferedRequestState<software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry>> |
KinesisStreamsSink.getWriterStateSerializer() |
StatefulSink.StatefulSinkWriter<InputT,BufferedRequestState<software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry>> |
KinesisStreamsSink.restoreWriter(Sink.InitContext context,
Collection<BufferedRequestState<software.amazon.awssdk.services.kinesis.model.PutRecordsRequestEntry>> recoveredState) |
Modifier and Type | Class and Description |
---|---|
class |
KinesisDynamicSink
Kinesis backed
AsyncDynamicTableSink . |
static class |
KinesisDynamicSink.KinesisDynamicTableSinkBuilder
Builder class for
KinesisDynamicSink . |
class |
KinesisDynamicTableSinkFactory
Factory for creating
KinesisDynamicSink . |
class |
KinesisPartitionKeyGeneratorFactory
Factory Class for
PartitionKeyGenerator . |
class |
RowDataFieldsKinesisPartitionKeyGenerator
A
PartitionKeyGenerator of RowData elements that constructs the partition key
from a list of field names. |
Modifier and Type | Class and Description |
---|---|
class |
KinesisStreamsConnectorOptionsUtils
Class for handling kinesis table options, including key mapping and validations and property
extraction.
|
static class |
KinesisStreamsConnectorOptionsUtils.KinesisProducerOptionsMapper
Class for Mapping and validation of deprecated producer options.
|
Modifier and Type | Class and Description |
---|---|
class |
PrintTableSinkFactory
Print table sink factory writing every row to the standard output or standard error stream.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarClientFactory
The factory for creating pulsar client classes from
PulsarConfiguration . |
class |
PulsarConfigBuilder
A builder for building the unmodifiable
Configuration instance. |
class |
PulsarConfigValidator
A config validator for building
PulsarConfiguration in PulsarConfigBuilder . |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSchema<T>
A wrapper for Pulsar
Schema , make it serializable and can be created from SchemaInfo . |
interface |
PulsarSchemaFactory<T>
The schema factory for a specified
SchemaType . |
class |
PulsarSchemaTypeInformation<T>
Wrap the pulsar
Schema into a flink TypeInformation . |
class |
PulsarSchemaTypeSerializer<T>
Wrap the pulsar
Schema into a flink TypeSerializer . |
class |
PulsarSchemaUtils
Util class for pulsar schema.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarExceptionUtils
Util class for pulsar checked exceptions.
|
class |
PulsarSerdeUtils
Util for serialize and deserialize.
|
class |
PulsarTransactionUtils
A suit of workarounds for the Pulsar Transaction.
|
Modifier and Type | Method and Description |
---|---|
Committer<PulsarCommittable> |
PulsarSink.createCommitter() |
TwoPhaseCommittingSink.PrecommittingSinkWriter<IN,PulsarCommittable> |
PulsarSink.createWriter(Sink.InitContext initContext) |
SimpleVersionedSerializer<PulsarCommittable> |
PulsarSink.getCommittableSerializer() |
Modifier and Type | Class and Description |
---|---|
class |
PulsarCommittable
The writer state for Pulsar connector.
|
class |
PulsarCommitter
Committer implementation for
PulsarSink . |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSinkConfigUtils
Create the
Producer to send message and a validator for building sink config. |
Modifier and Type | Class and Description |
---|---|
class |
PulsarWriter<IN>
This class is responsible to write records in a Pulsar topic and to handle the different delivery
DeliveryGuarantee s. |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSinkContextImpl
An implementation that would contain all the required context.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyHashTopicRouter<IN>
If you choose the
TopicRoutingMode.MESSAGE_KEY_HASH policy, we would use this
implementation. |
class |
RoundRobinTopicRouter<IN>
If you choose the
TopicRoutingMode.ROUND_ROBIN policy, we would use this implementation. |
Modifier and Type | Method and Description |
---|---|
InlineElement |
MessageKeyHash.getDescription() |
InlineElement |
TopicRoutingMode.getDescription() |
abstract org.apache.pulsar.client.impl.Hash |
MessageKeyHash.getHash() |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSchemaWrapper<IN>
Wrap the Pulsar's Schema into PulsarSerializationSchema.
|
class |
PulsarSerializationSchemaWrapper<IN>
Wrap the Flink's SerializationSchema into PulsarSerializationSchema.
|
Modifier and Type | Class and Description |
---|---|
class |
TopicMetadataListener
We need the latest topic metadata for making sure the newly created topic partitions would be
used by the Pulsar sink.
|
class |
TopicProducerRegister
All the Pulsar Producers share the same Client, but self hold the queue for a specified topic.
|
Modifier and Type | Method and Description |
---|---|
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.createEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext) |
SourceReader<OUT,PulsarPartitionSplit> |
PulsarSource.createReader(SourceReaderContext readerContext) |
SimpleVersionedSerializer<PulsarSourceEnumState> |
PulsarSource.getEnumeratorCheckpointSerializer() |
SimpleVersionedSerializer<PulsarPartitionSplit> |
PulsarSource.getSplitSerializer() |
SplitEnumerator<PulsarPartitionSplit,PulsarSourceEnumState> |
PulsarSource.restoreEnumerator(SplitEnumeratorContext<PulsarPartitionSplit> enumContext,
PulsarSourceEnumState checkpoint) |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSourceConfigUtils
Create source related
Consumer and validate config. |
Modifier and Type | Method and Description |
---|---|
InlineElement |
CursorVerification.getDescription() |
Modifier and Type | Class and Description |
---|---|
class |
PulsarSourceEnumerator
The enumerator class for the pulsar source.
|
Modifier and Type | Class and Description |
---|---|
class |
KeySharedSplitAssigner
This assigner is used for
SubscriptionType.Key_Shared subscription. |
interface |
SplitAssigner
The split assigner for different subscription.
|
class |
SplitAssignerFactory
The factory for creating split assigner.
|
Modifier and Type | Class and Description |
---|---|
static class |
CursorPosition.Type
The position type for reader to choose whether timestamp or message id as the start position.
|
class |
MessageIdUtils
The helper class for Pulsar's message id.
|
Modifier and Type | Method and Description |
---|---|
org.apache.pulsar.client.api.MessageId |
CursorPosition.getMessageId() |
Long |
CursorPosition.getTimestamp() |
CursorPosition.Type |
CursorPosition.getType() |
Modifier and Type | Interface and Description |
---|---|
interface |
PulsarSubscriber
Pulsar consumer allows a few different ways to consume from the topics, including:
Subscribe from a collection of topics.
|
Modifier and Type | Class and Description |
---|---|
class |
TopicNameUtils
util for topic name.
|
Modifier and Type | Method and Description |
---|---|
RangeGenerator.KeySharedMode |
TopicPartition.getMode()
This method is internal used for key shared mode.
|
List<org.apache.pulsar.client.api.Range> |
TopicPartition.getPulsarRanges()
This method is internal used for define key shared subscription.
|
List<TopicRange> |
TopicPartition.getRanges()
This method is internal used for serialization.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarSourceReaderFactory
This factory class is used for creating different types of source reader for different
subscription type.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarDeserializationSchemaInitializationContext
Convert the
SourceReaderContext into a DeserializationSchema.InitializationContext , we would use a pulsar named metric group for this
content. |
Modifier and Type | Class and Description |
---|---|
class |
PulsarFetcherManagerBase<T>
Common fetcher manager abstraction for both ordered & unordered message.
|
class |
PulsarOrderedFetcherManager<T>
Pulsar's FetcherManager implementation for ordered consuming.
|
class |
PulsarUnorderedFetcherManager<T>
Pulsar's FetcherManager implementation for unordered consuming.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarMessage<T>
The message instance that contains the required information which would be used for committing
the consuming status.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarOrderedSourceReader<OUT>
The source reader for pulsar subscription Failover and Exclusive, which consumes the ordered
messages.
|
class |
PulsarUnorderedSourceReader<OUT>
The source reader for pulsar subscription Shared and Key_Shared, which consumes the unordered
messages.
|
Modifier and Type | Class and Description |
---|---|
class |
PulsarOrderedPartitionSplitReader<OUT>
The split reader a given
PulsarPartitionSplit , it would be closed once the PulsarOrderedSourceReader is closed. |
class |
PulsarUnorderedPartitionSplitReader<OUT>
The split reader a given
PulsarPartitionSplit , it would be closed once the PulsarUnorderedSourceReader is closed. |
Modifier and Type | Class and Description |
---|---|
class |
PulsarPartitionSplit
A
SourceSplit implementation for a Pulsar's partition. |
Modifier and Type | Class and Description |
---|---|
class |
ConnectorTestingExtension
A JUnit 5
Extension for supporting running of connector testing framework. |
class |
TestCaseInvocationContextProvider
A helper class for injecting test resources into test case as parameters.
|
Modifier and Type | Class and Description |
---|---|
class |
UpsertTestFileUtil
Collection uf utility methods for reading and writing files from the
UpsertTestSink . |
Modifier and Type | Method and Description |
---|---|
SinkWriter<IN> |
UpsertTestSink.createWriter(Sink.InitContext context) |
Modifier and Type | Class and Description |
---|---|
class |
UpsertTestDynamicTableSinkFactory
A
DynamicTableSinkFactory for discovering UpsertTestDynamicTableSink . |
Modifier and Type | Interface and Description |
---|---|
interface |
HiveContinuousPartitionContext<P,T extends Comparable<T>>
Context for Hive continuous partition fetcher.
|
class |
HiveContinuousPartitionFetcher<T extends Comparable<T>>
A
ContinuousPartitionFetcher for hive table. |
interface |
HivePartitionContext<P>
Context for Hive partition fetcher.
|
Modifier and Type | Class and Description |
---|---|
class |
StandaloneApplicationClusterEntryPoint
An
ApplicationClusterEntryPoint which is started with a job in a predefined location. |
Modifier and Type | Class and Description |
---|---|
class |
RocksDBNativeMetricMonitor
A monitor which pulls {
RocksDB } native metrics and forwards them to Flink's metric group. |
class |
RocksDBProperty
RocksDB properties that can be queried by Flink's metrics reporter. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractRocksStateKeysIterator<K>
Base class for iterators over RocksDB column families.
|
Modifier and Type | Interface and Description |
---|---|
interface |
CacheSupportedPipelineExecutor
The pipeline executor that support caching intermediate dataset.
|
class |
DefaultExecutorServiceLoader
The default implementation of the
PipelineExecutorServiceLoader . |
class |
DetachedJobExecutionResult
The
JobExecutionResult returned by a context environment when executing a job in detached
mode. |
interface |
PipelineExecutor
The entity responsible for executing a
Pipeline , i.e. |
interface |
PipelineExecutorFactory
A factory for selecting and instantiating the adequate
PipelineExecutor based on a
provided Configuration . |
interface |
PipelineExecutorServiceLoader
An interface to be implemented by the entity responsible for finding the correct
PipelineExecutor to execute a given Pipeline . |
Modifier and Type | Method and Description |
---|---|
InlineElement |
SavepointFormatType.getDescription() |
Modifier and Type | Class and Description |
---|---|
class |
AutoCloseableRegistry
This class allows to register instances of
AutoCloseable , which are all closed if this
registry is closed. |
class |
BackPressuringExecutor
An executor decorator that allows only a certain number of concurrent executions.
|
class |
CloseableRegistry
This class allows to register instances of
Closeable , which are all closed if this
registry is closed. |
class |
ClosingFSDataInputStream
This class is a
WrappingProxy for FSDataInputStream that is
used to implement a safety net against unclosed streams. |
class |
ClosingFSDataOutputStream
This class is a
WrappingProxy for FSDataOutputStream that
is used to implement a safety net against unclosed streams. |
class |
ConnectionLimitingFactory
A wrapping factory that adds a
LimitedConnectionsFileSystem to a file system. |
class |
FileSystemSafetyNet
The FileSystemSafetyNet can be used to guard a thread against
FileSystem stream resource
leaks. |
class |
FSDataInputStreamWrapper
Simple forwarding wrapper around
FSDataInputStream . |
class |
FSDataOutputStreamWrapper
Simple forwarding wrapper around
FSDataInputStream . |
class |
LimitedConnectionsFileSystem
A file system that limits the number of concurrently open input streams, output streams, and
total streams for a target file system.
|
class |
OffsetAwareOutputStream
An
OutputStream that keeps track of its current length. |
class |
RefCountedBufferingFileStream
A
RefCountedFileWithStream that also uses an in-memory buffer for buffering small writes. |
class |
RefCountedFile
A reference counted file which is deleted as soon as no caller holds a reference to the wrapped
File . |
class |
RefCountedFileWithStream
A reference counted file which is deleted as soon as no caller holds a reference to the wrapped
File . |
class |
RefCountedFSOutputStream
A
FSDataOutputStream with the RefCounted functionality. |
class |
RefCountedTmpFileCreator
A utility class that creates local
reference counted files that
serve as temporary files. |
class |
SafetyNetCloseableRegistry
This implementation of an
AbstractAutoCloseableRegistry registers WrappingProxyCloseable . |
class |
SafetyNetWrapperFileSystem
This is a
WrappingProxy around FileSystem which (i) wraps all opened streams as
ClosingFSDataInputStream or ClosingFSDataOutputStream and (ii) registers them to
a SafetyNetCloseableRegistry . |
interface |
WrappingProxyCloseable<T extends Closeable>
WrappingProxy for Closeable that is also closeable. |
Modifier and Type | Method and Description |
---|---|
static void |
FileSystemSafetyNet.closeSafetyNetAndGuardedResourcesForThread()
Closes the safety net for a thread.
|
static FileSystem |
FileSystem.getUnguardedFileSystem(URI fsUri) |
static void |
FileSystemSafetyNet.initializeSafetyNetForThread()
Activates the safety net for a thread.
|
Modifier and Type | Class and Description |
---|---|
class |
LocalBlockLocation
Implementation of the
BlockLocation interface for a local file system. |
class |
LocalDataInputStream
The
LocalDataInputStream class is a wrapper class for a data input stream to the
local file system. |
class |
LocalDataOutputStream
The
LocalDataOutputStream class is a wrapper class for a data output stream to the
local file system. |
class |
LocalFileStatus
The class
LocalFileStatus provides an implementation of the FileStatus
interface for the local file system. |
class |
LocalFileSystem
The class
LocalFileSystem is an implementation of the FileSystem interface for
the local file system of the machine where the JVM runs. |
class |
LocalRecoverableFsDataOutputStream
A
RecoverableFsDataOutputStream for the LocalFileSystem . |
class |
LocalRecoverableWriter
A
RecoverableWriter for the LocalFileSystem . |
Modifier and Type | Class and Description |
---|---|
class |
PostVersionedIOReadableWritable
A
VersionedIOReadableWritable which allows to differentiate whether the previous data was
versioned with a VersionedIOReadableWritable . |
class |
SimpleVersionedSerializerTypeSerializerProxy<T>
A
TypeSerializer that delegates to an underlying SimpleVersionedSerializer . |
class |
VersionedIOReadableWritable
This is the abstract base class for
IOReadableWritable which allows to differentiate
between serialization versions. |
Modifier and Type | Class and Description |
---|---|
class |
ByteArrayInputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayInputStream that also exposes the current
position.
|
class |
ByteArrayOutputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayOutputStream that also exposes the current
position.
|
class |
ManagedMemoryUseCase
Use cases of managed memory.
|
class |
MemorySegment
This class represents a piece of memory managed by Flink.
|
class |
MemorySegmentFactory
A factory for memory segments (
MemorySegment ). |
interface |
MemorySegmentSource
Interface describing entities that can provide memory segments.
|
interface |
MemorySegmentWritable
Provides the interface for write(Segment).
|
class |
MemoryUtils
Utility class for memory operations.
|
Modifier and Type | Class and Description |
---|---|
class |
DefaultPluginManager
Default implementation of
PluginManager . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractAvroBulkFormat<A,T,SplitT extends FileSourceSplit>
Provides a
BulkFormat for Avro records. |
class |
AvroFileFormatFactory
Avro format factory for file system.
|
class |
AvroFormatFactory
Table format factory for providing configured instances of Avro to RowData
SerializationSchema and DeserializationSchema . |
class |
AvroToRowDataConverters
Tool class used to convert from Avro
GenericRecord to RowData . |
class |
RowDataToAvroConverters
Tool class used to convert from
RowData to Avro GenericRecord . |
Modifier and Type | Class and Description |
---|---|
class |
RegistryAvroFormatFactory
Table format factory for providing configured instances of Schema Registry Avro to RowData
SerializationSchema and DeserializationSchema . |
Modifier and Type | Class and Description |
---|---|
class |
DebeziumAvroDeserializationSchema
Deserialization schema from Debezium Avro to Flink Table/SQL internal data structure
RowData . |
class |
DebeziumAvroFormatFactory
Format factory for providing configured instances of Debezium Avro to RowData
DeserializationSchema . |
class |
DebeziumAvroSerializationSchema
Serialization schema from Flink Table/SQL internal data structure
RowData to Debezium
Avro. |
Modifier and Type | Class and Description |
---|---|
class |
AvroFactory<T>
Creates Avro
DatumReader and DatumWriter . |
Modifier and Type | Class and Description |
---|---|
class |
TimeFormats
Time formats and timestamp formats respecting the RFC3339 specification, ISO-8601 specification
and SQL specification.
|
class |
TimestampFormat
Timestamp format Enums.
|
Modifier and Type | Class and Description |
---|---|
class |
CsvFileFormatFactory
CSV format factory for file system.
|
class |
CsvFormatFactory
Format factory for providing configured instances of CSV to RowData
SerializationSchema
and DeserializationSchema . |
class |
CsvRowDataDeserializationSchema
Deserialization schema from CSV to Flink Table & SQL internal data structures.
|
static class |
CsvRowDataDeserializationSchema.Builder
A builder for creating a
CsvRowDataDeserializationSchema . |
class |
CsvToRowDataConverters
Tool class used to convert from CSV-format
JsonNode to RowData . |
class |
RowDataToCsvConverters
Tool class used to convert from
RowData to CSV-format JsonNode . |
Modifier and Type | Interface and Description |
---|---|
interface |
HadoopFileCommitter
The committer publishes an intermediate Hadoop file to the target path after it finishes writing.
|
interface |
HadoopFileCommitterFactory
The factory to create the
HadoopFileCommitter . |
interface |
HadoopPathBasedBulkWriter<T>
Specialized
BulkWriter which is expected to write to specified Path . |
Modifier and Type | Class and Description |
---|---|
class |
JsonFormatFactory
Table format factory for providing configured instances of JSON to RowData
SerializationSchema and DeserializationSchema . |
class |
JsonFormatOptionsUtil
Utilities for
JsonFormatOptions . |
class |
JsonRowDataDeserializationSchema
Deserialization schema from JSON to Flink Table/SQL internal data structure
RowData . |
class |
JsonRowDataSerializationSchema
Serialization schema that serializes an object of Flink internal data structure into a JSON
bytes.
|
class |
JsonToRowDataConverters
Tool class used to convert from
JsonNode to RowData . |
class |
RowDataToJsonConverters
Tool class used to convert from
RowData to JsonNode . |
Modifier and Type | Class and Description |
---|---|
static class |
CanalJsonDeserializationSchema.Builder
A builder for creating a
CanalJsonDeserializationSchema . |
class |
CanalJsonFormatFactory
Format factory for providing configured instances of Canal JSON to RowData
DeserializationSchema . |
Modifier and Type | Class and Description |
---|---|
class |
DebeziumJsonDeserializationSchema
Deserialization schema from Debezium JSON to Flink Table/SQL internal data structure
RowData . |
class |
DebeziumJsonFormatFactory
Format factory for providing configured instances of Debezium JSON to RowData
DeserializationSchema . |
Modifier and Type | Class and Description |
---|---|
class |
MaxwellJsonFormatFactory
Format factory for providing configured instances of Maxwell JSON to RowData
DeserializationSchema . |
Modifier and Type | Class and Description |
---|---|
class |
OggJsonDeserializationSchema
Deserialization schema from Ogg JSON to Flink Table/SQL internal data structure
RowData . |
class |
OggJsonFormatFactory
Format factory for providing configured instances of Ogg JSON to RowData
DeserializationSchema . |
Modifier and Type | Class and Description |
---|---|
class |
ParquetDecimalVector
Parquet write decimal as int32 and int64 and binary, this class wrap the real vector to provide
DecimalColumnVector interface. |
Modifier and Type | Class and Description |
---|---|
class |
RawFormatDeserializationSchema
Deserialization schema from raw (byte based) value to Flink Table/SQL internal data structure
RowData . |
class |
RawFormatFactory
Format factory for raw format which allows to read and write raw (byte based) values as a single
column.
|
class |
RawFormatSerializationSchema
Serialization schema that serializes an
RowData object into raw (byte based) value. |
Modifier and Type | Class and Description |
---|---|
class |
OSSRecoverableSerializer
Serializer implementation for a
OSSRecoverable . |
Modifier and Type | Interface and Description |
---|---|
interface |
S3AccessHelper
An interface that abstracts away the Multi-Part Upload (MPU) functionality offered by S3, from
the specific implementation of the file system.
|
Modifier and Type | Class and Description |
---|---|
class |
ByteValueArrayComparator
Specialized comparator for ByteValueArray based on CopyableValueComparator.
|
class |
CharValueArrayComparator
Specialized comparator for CharValueArray based on CopyableValueComparator.
|
class |
DoubleValueArrayComparator
Specialized comparator for DoubleValueArray based on CopyableValueComparator.
|
class |
FloatValueArrayComparator
Specialized comparator for FloatValueArray based on CopyableValueComparator.
|
class |
IntValueArrayComparator
Specialized comparator for IntValueArray based on CopyableValueComparator.
|
class |
LongValueArrayComparator
Specialized comparator for LongValueArray based on CopyableValueComparator.
|
class |
NullValueArrayComparator
Specialized comparator for NullValueArray based on CopyableValueComparator.
|
class |
ShortValueArrayComparator
Specialized comparator for ShortValueArray based on CopyableValueComparator.
|
class |
StringValueArrayComparator
Specialized comparator for StringValueArray based on CopyableValueComparator.
|
Modifier and Type | Class and Description |
---|---|
class |
KubernetesClusterClientFactory
A
ClusterClientFactory for a Kubernetes cluster. |
Modifier and Type | Class and Description |
---|---|
class |
KubernetesSessionCli
Kubernetes customized commandline.
|
Modifier and Type | Class and Description |
---|---|
class |
KubernetesConfigOptionsInternal
Kubernetes configuration options that are not meant to be set by the user.
|
class |
KubernetesDeploymentTarget
A class containing all the supported deployment target names for Kubernetes.
|
Modifier and Type | Class and Description |
---|---|
class |
KubernetesApplicationClusterEntrypoint
An
ApplicationClusterEntryPoint for Kubernetes. |
Modifier and Type | Class and Description |
---|---|
class |
KubernetesSessionClusterExecutor
The
PipelineExecutor to be used when executing a job on an already running cluster. |
class |
KubernetesSessionClusterExecutorFactory
An
PipelineExecutorFactory for executing jobs on an existing (session) cluster. |
Modifier and Type | Class and Description |
---|---|
class |
MeterView
A MeterView provides an average rate of events per second over a given time period.
|
class |
SimpleCounter
A simple low-overhead
Counter that is not thread-safe. |
class |
ThreadSafeSimpleCounter
A simple low-overhead
Counter that is thread-safe. |
Modifier and Type | Class and Description |
---|---|
class |
UnregisteredMetricsGroup
A special
MetricGroup that does not register any metrics at the metrics registry and any
reporters. |
Modifier and Type | Class and Description |
---|---|
class |
OrcBulkWriter<T>
A
BulkWriter implementation that writes data in ORC format. |
class |
PhysicalWriterImpl
A slightly customised clone of
PhysicalFsWriter . |
class |
ThreadLocalClassLoaderConfiguration
Workaround for https://issues.apache.org/jira/browse/ORC-653.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonConfig
Configurations for the Python job which are used at run time.
|
interface |
PythonFunctionRunner
The base interface of runner which is responsible for the execution of Python functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonEnvironmentManager
The base class of python environment manager which is used to create the PythonEnvironment object
used to execute Python functions.
|
class |
PythonDependencyInfo
PythonDependencyInfo contains the information of third-party dependencies.
|
interface |
PythonEnvironment
The base interface of python environment for executing UDFs.
|
interface |
PythonEnvironmentManager
The base interface of python environment manager which is used to create the PythonEnvironment
object used to execute Python functions.
|
Modifier and Type | Class and Description |
---|---|
class |
EmbeddedPythonEnvironment
A
PythonEnvironment for executing UDFs in embedded environment. |
class |
EmbeddedPythonEnvironmentManager
The base class of python environment manager which is used to create the PythonEnvironment
object.
|
Modifier and Type | Class and Description |
---|---|
class |
ProcessPythonEnvironment
A
PythonEnvironment for executing UDFs in Process. |
class |
ProcessPythonEnvironmentManager
The ProcessPythonEnvironmentManager is used to prepare the working dir of python UDF worker and
create ProcessPythonEnvironment object of Beam Fn API.
|
Modifier and Type | Class and Description |
---|---|
class |
MetricDistribution
Flink
Gauge for Python Distribution. |
class |
MetricGauge
Flink
Gauge for Python Gauge. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkMetricContainer
Helper class for forwarding Python metrics to Java accumulators and metrics.
|
Modifier and Type | Class and Description |
---|---|
class |
CompressionUtils
Utils used to extract compressed files.
|
class |
HashMapWrapper
Helper class to create a
HashMap taking Numeric data as key or value from Python side. |
class |
ProtoUtils
Utilities used to construct protobuf objects or construct objects from protobuf objects.
|
class |
PythonDependencyUtils
Utility class for Python dependency management.
|
class |
PythonEnvironmentManagerUtils
Utils used to prepare the python environment.
|
Modifier and Type | Class and Description |
---|---|
class |
VoidNamespace
Singleton placeholder class for state without a namespace.
|
class |
VoidNamespaceSerializer
Serializer for
VoidNamespace . |
class |
VoidNamespaceTypeInfo
|
Modifier and Type | Class and Description |
---|---|
class |
KvStateClientProxyHandler
This handler acts as an internal (to the Flink cluster) client that receives the requests from
external clients, executes them by contacting the Job Manager (if necessary) and the Task Manager
holding the requested state, and forwards the answer back to the client.
|
class |
KvStateClientProxyImpl
The default implementation of the
KvStateClientProxy . |
Modifier and Type | Class and Description |
---|---|
class |
UnknownKeyOrNamespaceException
Thrown if the KvState does not hold any state for the given key or namespace.
|
class |
UnknownKvStateIdException
Thrown if no KvState with the given ID cannot found by the server handler.
|
class |
UnknownKvStateKeyGroupLocationException
Exception thrown if there is no location information available for the given key group.
|
class |
UnknownLocationException
Exception to fail Future if the Task Manager on which the
Client Proxy is running on,
does not know the location of a requested state. |
Modifier and Type | Class and Description |
---|---|
class |
KvStateInternalRequest
The request to be forwarded by the
Queryable State Client Proxy to the State
Server of the Task Manager responsible for the requested state. |
class |
KvStateRequest
The request to be sent by the
Queryable State Client to the Client Proxy requesting a given state. |
class |
KvStateResponse
The response containing the (serialized) state sent by the
State Server to the Client Proxy , and then forwarded by the proxy to the original Queryable State Client . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractServerBase<REQ extends MessageBody,RESP extends MessageBody>
The base class for every server in the queryable state module.
|
class |
AbstractServerHandler<REQ extends MessageBody,RESP extends MessageBody>
The base class of every handler used by an
AbstractServerBase . |
class |
BadRequestException
Base class for exceptions thrown during querying Flink's managed state.
|
class |
ChunkedByteBuf
A
ByteBuf instance to be consumed in chunks by ChunkedWriteHandler , respecting
the high and low watermarks. |
class |
Client<REQ extends MessageBody,RESP extends MessageBody>
The base class for every client in the queryable state module.
|
class |
ClientHandler<REQ extends MessageBody,RESP extends MessageBody>
The handler used by a
Client to handling incoming messages. |
interface |
ClientHandlerCallback<RESP extends MessageBody>
Callback for
ClientHandler . |
Modifier and Type | Class and Description |
---|---|
class |
MessageBody
|
interface |
MessageDeserializer<M extends MessageBody>
A utility used to deserialize a
message . |
class |
MessageSerializer<REQ extends MessageBody,RESP extends MessageBody>
|
class |
MessageType
|
class |
RequestFailure
A message indicating a protocol-related error.
|
Modifier and Type | Class and Description |
---|---|
class |
KvStateServerHandler
This handler dispatches asynchronous tasks, which query
InternalKvState instances and
write the result to the channel. |
class |
KvStateServerImpl
The default implementation of the
KvStateServer . |
Modifier and Type | Class and Description |
---|---|
class |
CheckpointRetentionPolicy
Policy for whether checkpoints are retained after a job terminates.
|
class |
CompletedCheckpointStatsSummarySnapshot
Immutable snapshot of
CompletedCheckpointStatsSummary . |
interface |
OperatorStateRepartitioner<T>
Interface that allows to implement different strategies for repartitioning of operator state as
parallelism changes.
|
static interface |
PerJobCheckpointRecoveryFactory.CheckpointStoreRecoveryHelper<StoreType extends CompletedCheckpointStore>
Restores or creates a
CompletedCheckpointStore , optionally using an existing one. |
class |
PrioritizedOperatorSubtaskState
This class is a wrapper over multiple alternative
OperatorSubtaskState that are (partial)
substitutes for each other and imposes a priority ordering over all alternatives for the
different states which define an order in which the operator should attempt to restore the state
from them. |
static class |
PrioritizedOperatorSubtaskState.Builder
A builder for PrioritizedOperatorSubtaskState.
|
class |
RoundRobinOperatorStateRepartitioner
Current default implementation of
OperatorStateRepartitioner that redistributes state in
round robin fashion. |
class |
StateAssignmentOperation
This class encapsulates the operation of assigning restored state when restoring from a
checkpoint.
|
class |
StatsSummarySnapshot
Immutable snapshot of
StatsSummary . |
Modifier and Type | Interface and Description |
---|---|
interface |
ChannelStateWriter
Writes channel state during checkpoint/savepoint.
|
class |
ChannelStateWriterImpl
ChannelStateWriter implemented using CheckpointStateOutputStreams . |
class |
InputChannelInfo
Identifies
InputChannel in a given
subtask. |
class |
ResultSubpartitionInfo
Identifies
ResultSubpartition in a given subtask. |
interface |
SequentialChannelStateReader
Reads channel state saved during checkpoint/savepoint.
|
Modifier and Type | Class and Description |
---|---|
class |
MetadataV1Serializer
Deserializer for checkpoints written in format
1 (Flink 1.2.x format). |
class |
MetadataV2Serializer
(De)serializer for checkpoint metadata format version 2.
|
class |
MetadataV2V3SerializerBase
Base (De)serializer for checkpoint metadata format version 2 and 3.
|
class |
MetadataV3Serializer
(De)serializer for checkpoint metadata format version 3.
|
class |
MetadataV4Serializer
V4 serializer that adds
CheckpointProperties
serialization. |
Modifier and Type | Class and Description |
---|---|
class |
ConfigurationNotAllowedMessage
If
DeploymentOptions.PROGRAM_CONFIG_ENABLED is disabled, this error denotes the not
allowed configuration. |
interface |
DispatcherBootstrap
An interface containing the logic of bootstrapping the
Dispatcher of a cluster. |
interface |
DispatcherBootstrapFactory
A factory to create a
DispatcherBootstrap . |
class |
NoOpDispatcherBootstrap
A
DispatcherBootstrap which submits the provided job graphs for
execution upon dispatcher initialization. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractDispatcherLeaderProcess
A base
DispatcherLeaderProcess . |
class |
DefaultDispatcherGatewayService
A facade over the
Dispatcher that exposes specific functionality. |
interface |
DispatcherLeaderProcessFactoryFactory
Factory for
DispatcherLeaderProcessFactory . |
class |
SessionDispatcherLeaderProcessFactory
Factory for the
SessionDispatcherLeaderProcess . |
Modifier and Type | Interface and Description |
---|---|
interface |
JobStatusHook
Hooks provided by users on job status changing.
|
class |
SimpleInitializeOnMasterContext
A simple pojo based implementation of
JobVertex.InitializeOnMasterContext . |
Modifier and Type | Class and Description |
---|---|
class |
HadoopRecoverableWriter
An implementation of the
RecoverableWriter for Hadoop's file system abstraction. |
Modifier and Type | Interface and Description |
---|---|
interface |
JobResultStore
A storage for the results of globally terminated jobs.
|
Modifier and Type | Interface and Description |
---|---|
interface |
AvailabilityProvider
Interface defining couple of essential methods for listening on data availability using
CompletableFuture . |
interface |
PullingAsyncDataInput<T>
Interface defining couple of essential methods for asynchronous and non blocking data polling.
|
Modifier and Type | Class and Description |
---|---|
class |
FileBasedBufferIterator
CloseableIterator of buffers over file content. |
Modifier and Type | Class and Description |
---|---|
class |
StopMode
Tells if the job is stopping because of consuming all data.
|
Modifier and Type | Class and Description |
---|---|
class |
SubtaskStateMapper
The
SubtaskStateMapper narrows down the subtasks that need to be read during rescaling to
recover from a particular subtask when in-flight data has been stored in the checkpoint. |
Modifier and Type | Class and Description |
---|---|
class |
PrioritizedDeque<T>
A deque-like data structure that supports prioritization of elements, such they will be polled
before any non-priority elements.
|
Modifier and Type | Interface and Description |
---|---|
interface |
CheckpointableInput
Input, with just basic methods for blocking and resuming consumption.
|
Modifier and Type | Method and Description |
---|---|
InlineElement |
RestoreMode.getDescription() |
Modifier and Type | Class and Description |
---|---|
class |
JsonPlanGenerator |
Modifier and Type | Interface and Description |
---|---|
interface |
CheckpointableTask
A task that participates in checkpointing.
|
interface |
CoordinatedTask
An task that is coordinated, i.e.
|
interface |
TaskInvokable
An invokable part of the task.
|
Modifier and Type | Class and Description |
---|---|
static class |
JobResult.Builder
Builder for
JobResult . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractMetricGroup<A extends AbstractMetricGroup<?>>
Abstract
MetricGroup that contains key functionality for adding metrics and groups. |
class |
ComponentMetricGroup<P extends AbstractMetricGroup<?>>
Abstract
MetricGroup for system components (e.g., TaskManager,
Job, Task, Operator). |
class |
GenericKeyMetricGroup
A
GenericMetricGroup for representing the key part of a key-value metric group pair. |
class |
GenericMetricGroup
A simple named
MetricGroup that is used to hold subgroups of
metrics. |
class |
GenericValueMetricGroup
A
GenericMetricGroup for representing the value part of a key-value metric group pair. |
class |
InternalCacheMetricGroup
A
CacheMetricGroup which register all cache related metrics under a subgroup of the
parent metric group. |
class |
InternalOperatorIOMetricGroup
Metric group that contains shareable pre-defined IO-related metrics.
|
class |
InternalOperatorMetricGroup
Special
MetricGroup representing an Operator. |
class |
InternalSinkWriterMetricGroup
Special
MetricGroup representing an Operator. |
class |
InternalSourceReaderMetricGroup
Special
MetricGroup representing an Operator. |
class |
JobManagerJobMetricGroup
Special
MetricGroup representing everything belonging to a
specific job, running on the JobManager. |
class |
JobMetricGroup<C extends ComponentMetricGroup<C>>
Special abstract
MetricGroup representing everything belonging
to a specific job. |
class |
TaskManagerJobMetricGroup
Special
MetricGroup representing everything belonging to a
specific job, running on the TaskManager. |
class |
TaskManagerMetricGroup
Special
MetricGroup representing a TaskManager. |
class |
TaskMetricGroup
Special
MetricGroup representing a Flink runtime Task. |
Modifier and Type | Method and Description |
---|---|
void |
MiniCluster.overrideRestoreModeForChangelogStateBackend() |
Modifier and Type | Interface and Description |
---|---|
interface |
CoordinatorStore
CoordinatorStore can be used for sharing some information among OperatorCoordinator instances. |
class |
CoordinatorStoreImpl
Basic implementation of
CoordinatorStore . |
interface |
OperatorCoordinator
A coordinator for runtime operators.
|
Modifier and Type | Class and Description |
---|---|
class |
KvStateEntry<K,N,V>
An entry holding the
InternalKvState along with its KvStateInfo . |
Modifier and Type | Interface and Description |
---|---|
interface |
ScaleUpController
Simple policy for controlling the scale up behavior of the
AdaptiveScheduler . |
Modifier and Type | Class and Description |
---|---|
class |
KerberosUtils
Provides vendor-specific Kerberos
AppConfigurationEntry instances. |
Modifier and Type | Class and Description |
---|---|
class |
JaasModule
Responsible for installing a process-wide JAAS configuration.
|
Modifier and Type | Class and Description |
---|---|
class |
SourceCoordinator<SplitT extends SourceSplit,EnumChkT>
The default implementation of the
OperatorCoordinator for the Source . |
class |
SourceCoordinatorContext<SplitT extends SourceSplit>
A context class for the
OperatorCoordinator . |
class |
SplitAssignmentTracker<SplitT extends SourceSplit>
A class that is responsible for tracking the past split assignments made by
SplitEnumerator . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractChannelStateHandle<Info>
Abstract channel state handle.
|
class |
CheckpointStateOutputStream
A dedicated output stream that produces a
StreamStateHandle when closed. |
interface |
CheckpointStateToolset
A toolset of operations that can be performed on a location embedded within the class.
|
class |
CheckpointStorageLoader
This class contains utility methods to load checkpoint storage from configurations.
|
interface |
CheckpointStorageWorkerView
This interface implements the durable storage of checkpoint data and metadata streams.
|
interface |
ConfigurableCheckpointStorage
An interface for checkpoint storage types that pick up additional parameters from a
configuration.
|
interface |
ConfigurableStateBackend
An interface for state backends that pick up additional parameters from a configuration.
|
class |
DefaultOperatorStateBackend
Default implementation of OperatorStateStore that provides the ability to make snapshots.
|
interface |
FullSnapshotResources<K>
A
SnapshotResources to be used with the backend-independent FullSnapshotAsyncWriter . |
class |
HeapPriorityQueuesManager
Manages creating heap priority queues along with their counterpart meta info.
|
class |
InputChannelStateHandle
Handle to an InputChannel state. |
interface |
InternalPriorityQueue<T>
Interface for collection that gives in order access to elements w.r.t their priority.
|
interface |
IterableStateSnapshot<K,N,S>
A
StateSnapshot that can return an iterator over all contained StateEntries . |
class |
JavaSerializer<T extends Serializable>
A
TypeSerializer that uses Java serialization. |
interface |
OwnedTaskLocalStateStore
This interface represents the administrative interface to
TaskLocalStateStore , that only
the owner of the object should see. |
class |
ResultSubpartitionStateHandle
Handle to a ResultSubpartition state. |
class |
SavepointResources<K>
Savepoint resources for a
KeyedStateBackend . |
class |
SerializedCompositeKeyBuilder<K>
Responsible for serialization of currentKey, currentGroup and namespace.
|
class |
SharedStateRegistryImpl
SharedStateRegistry implementation. |
class |
SnappyStreamCompressionDecorator
This implementation decorates the stream with snappy compression.
|
interface |
Snapshotable<S extends StateObject>
Interface for objects that can snapshot its state (state backends currently).
|
interface |
SnapshotResources
A set of resources produced in the synchronous part of a snapshot required to finish the
snapshot.
|
interface |
SnapshotStrategy<S extends StateObject,SR extends SnapshotResources>
Interface for different snapshot approaches in state backends.
|
class |
StateSerializerProvider<T>
A
StateSerializerProvider wraps logic on how to obtain serializers for registered state,
either with the previous schema of state in checkpoints or the current schema of state. |
interface |
StateSnapshot
General interface for state snapshots that should be written partitioned by key-groups.
|
interface |
StateSnapshotKeyGroupReader
Interface for state de-serialization into
StateTable s by key-group. |
interface |
StateSnapshotRestore
Interface to deal with state snapshot and restore of state.
|
interface |
StateTransformationFunction<S,T>
Interface for a binary function that is used for push-down of state transformation into state
backends.
|
class |
StreamCompressionDecorator
Implementations of this interface decorate streams with a compression scheme.
|
interface |
TaskLocalStateStore
Classes that implement this interface serve as a task-manager-level local storage for local
checkpointed state.
|
class |
UncompressedStreamCompressionDecorator
This implementation does not decorate the stream with any compression.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ChangelogStateBackendHandle
A handle to ChangelogStateBackend state.
|
interface |
ChangelogStateHandle
A handle to saved
state changes . |
class |
ChangelogStateHandleStreamImpl
ChangelogStateHandle implementation based on StreamStateHandle . |
interface |
LocalChangelogRegistry
This registry is responsible for deleting changlog's local handles which are not in use.
|
class |
LocalChangelogRegistryImpl |
interface |
SequenceNumber
A logical timestamp to draw a boundary between the materialized and non-materialized changes.
|
class |
StateChange
Change of state of a keyed operator.
|
interface |
StateChangelogHandleReader<Handle extends ChangelogStateHandle>
Allows to read state changelog referenced by the provided
ChangelogStateHandle . |
class |
StateChangelogHandleStreamHandleReader
A reader for
ChangelogStateHandleStreamImpl that iterates over its underlying stream handles and offsets. |
interface |
StateChangelogStorage<Handle extends ChangelogStateHandle>
A storage for changelog.
|
interface |
StateChangelogStorageFactory
A factory for
StateChangelogStorage . |
class |
StateChangelogStorageLoader
A thin wrapper around
PluginManager to load StateChangelogStorage . |
interface |
StateChangelogStorageView<Handle extends ChangelogStateHandle>
A storage view for changelog.
|
interface |
StateChangelogWriter<Handle extends ChangelogStateHandle>
Allows to write data to the log.
|
Modifier and Type | Class and Description |
---|---|
class |
InMemoryChangelogStateHandle
In-memory
ChangelogStateHandle . |
Modifier and Type | Interface and Description |
---|---|
interface |
DelegatingStateBackend
An interface to delegate state backend.
|
Modifier and Type | Class and Description |
---|---|
class |
FSDataOutputStreamWrapper
Implementation of
MetadataOutputStreamWrapper encapsulates the FSDataOutputStream
for FsCheckpointMetadataOutputStream . |
class |
MetadataOutputStreamWrapper
The wrapper manages metadata output stream close and commit.
|
class |
RecoverableStreamWrapper
Implementation of
MetadataOutputStreamWrapper encapsulates the RecoverableFsDataOutputStream for FsCheckpointMetadataOutputStream . |
Modifier and Type | Method and Description |
---|---|
static FsCompletedCheckpointStorageLocation |
AbstractFsCheckpointStorageAccess.resolveCheckpointPointer(String checkpointPointer)
Takes the given string (representing a pointer to a checkpoint) and resolves it to a file
status for the checkpoint's metadata file.
|
Modifier and Type | Class and Description |
---|---|
class |
CopyOnWriteStateTableSnapshot<K,N,S>
This class represents the snapshot of a
CopyOnWriteStateTable and has a role in operator
state checkpointing. |
class |
HeapKeyValueStateIterator
A
KeyValueStateIterator over Heap backend snapshot
resources. |
interface |
HeapPriorityQueueElement
Interface for objects that can be managed by a
HeapPriorityQueue . |
interface |
InternalKeyContext<K>
This interface is the current context of a keyed state.
|
class |
StateTableByKeyGroupReaders
This class provides a static factory method to create different implementations of
StateSnapshotKeyGroupReader depending on the provided serialization format version. |
Modifier and Type | Class and Description |
---|---|
class |
LatencyTrackingStateConfig
Config to create latency tracking state metric.
|
Modifier and Type | Class and Description |
---|---|
class |
FullSnapshotRestoreOperation<K>
The procedure of restoring state from a savepoint written with the unified binary format.
|
class |
KeyGroup
Part of a savepoint representing data for a single key group.
|
class |
KeyGroupEntry
Part of a savepoint representing data for a single state entry in a key group.
|
interface |
ThrowingIterator<E>
Modified
Iterator interface that lets the implementation throw an IOException . |
Modifier and Type | Class and Description |
---|---|
class |
AsynchronousException
An exception for wrapping exceptions that are thrown by an operator in threads other than the
main compute thread of that operator.
|
interface |
CheckpointResponder
Responder for checkpoint acknowledge and decline messages in the
Task . |
Modifier and Type | Class and Description |
---|---|
class |
ForwardingInputStream
Input stream, that wraps another input stream and forwards all method calls to the wrapped
stream.
|
class |
ForwardingOutputStream
OutputStream , that wraps another OutputStream and forwards all method calls to
the wrapped stream. |
class |
NonClosingInputStreamDecorator
Decorator for input streams that ignores calls to
InputStream.close() . |
class |
NonClosingOutputStreamDecorator
Decorator for input streams that ignores calls to
OutputStream.close() . |
Modifier and Type | Class and Description |
---|---|
class |
SqlCompilePlan
AST node for
COMPILE PLAN 'planfile' [IF NOT EXISTS] FOR [DML] . |
class |
SqlReset
SQL call for "RESET" and "RESET 'key'".
|
class |
SqlSet
SQL call for "SET" and "SET 'key' = 'value'".
|
Modifier and Type | Class and Description |
---|---|
class |
SqlCompileAndExecutePlan
AST node for
COMPILE AND EXECUTE PLAN 'planfile' FOR [DML] . |
class |
SqlExecutePlan
AST node for
EXECUTE PLAN 'planfile' . |
Modifier and Type | Class and Description |
---|---|
class |
SqlRawTypeNameSpec
Represents a raw type such as
RAW('org.my.Class', 'sW3Djsds...') . |
class |
SqlTimestampLtzTypeNameSpec
Represents type TIMESTAMP_LTZ(int) which is a synonym of type TIMESTAMP(int) WITH LOCAL TIME
ZONE.
|
Modifier and Type | Method and Description |
---|---|
<R> StateBootstrapTransformation<T> |
WindowedStateTransformation.reduce(ReduceFunction<T> reduceFunction,
ProcessWindowFunction<T,R,K,W> function)
Applies the given window function to each window.
|
<R> BootstrapTransformation<T> |
WindowedOperatorTransformation.reduce(ReduceFunction<T> reduceFunction,
ProcessWindowFunction<T,R,K,W> function)
Applies the given window function to each window.
|
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateInputFormat<K,V>
The input format for reading
BroadcastState . |
class |
KeyedStateInputFormat<K,N,OUT>
Input format for reading partitioned state.
|
class |
ListStateInputFormat<OT>
Input format for reading operator list state.
|
class |
MultiStateKeyIterator<K>
An iterator for reading all keys in a state backend across multiple partitioned states.
|
class |
SourceBuilder
A utility for constructing
InputFormat based sources that are marked as BOUNDED. |
class |
UnionStateInputFormat<OT>
Input format for reading operator union state.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyedStateReaderOperator<KEY,OUT>
A
StateReaderOperator for executing a KeyedStateReaderFunction . |
class |
StateReaderOperator<F extends Function,KEY,N,OUT>
Base class for executing functions that read keyed state.
|
class |
WindowReaderOperator<S extends State,KEY,IN,W extends Window,OUT>
A
StateReaderOperator for reading WindowOperator state. |
Modifier and Type | Class and Description |
---|---|
class |
AggregateEvictingWindowReaderFunction<IN,ACC,R,OUT,KEY,W extends Window>
A wrapper for reading an evicting window operator with an aggregate function.
|
class |
EvictingWindowReaderFunction<IN,R,OUT,KEY,W extends Window>
Wrapper for reading state from an evicting window operator.
|
class |
ProcessEvictingWindowReader<IN,OUT,KEY,W extends Window>
A wrapper function for reading an evicting window with no pre-aggregation.
|
class |
ReduceEvictingWindowReaderFunction<IN,OUT,KEY,W extends Window>
A wrapper function for reading state from an evicting window operator with a reduce function.
|
Modifier and Type | Class and Description |
---|---|
class |
KeyGroupRangeInputSplit
An input split representing a key-group range from a savepoint.
|
class |
OperatorStateInputSplit
An input split containing state handles for operator state.
|
interface |
PrioritizedOperatorSubtaskStateInputSplit
An input split that returns
PrioritizedOperatorSubtaskState . |
Modifier and Type | Class and Description |
---|---|
class |
BootstrapStreamTaskRunner<IN>
The runtime for a
BootstrapStreamTask . |
class |
BoundedOneInputStreamTaskRunner<IN>
Deprecated.
|
class |
FileCopyFunction
This output format copies files from an existing savepoint into a new directory.
|
class |
MergeOperatorStates
A reducer that aggregates multiple
OperatorState 's into a single CheckpointMetadata . |
class |
OperatorSubtaskStateReducer
A reducer that aggregates all
OperatorSubtaskState 's for a particular operator into a
single OperatorState . |
class |
SavepointOutputFormat
An output format to serialize
CheckpointMetadata metadata to distributed storage. |
class |
SnapshotUtils
Takes a final snapshot of the state of an operator subtask.
|
class |
StatePathExtractor
Extracts all file paths that are part of the provided
OperatorState . |
class |
TaggedOperatorSubtaskState
A simple wrapper pojo that tags
OperatorSubtaskState with metadata. |
class |
TimestampAssignerWrapper<T>
Deprecated.
|
Modifier and Type | Class and Description |
---|---|
class |
BroadcastStateBootstrapOperator<IN>
A
StreamOperator for executing BroadcastStateBootstrapFunction 's. |
class |
GroupReduceOperator<IN,OUT>
An operator for executing a
GroupReduceFunction on a bounded DataStream. |
class |
KeyedStateBootstrapOperator<K,IN>
A
StreamOperator for executing KeyedStateBootstrapFunction 's. |
class |
LazyTimerService
A timer service that initializes its internal timer service lazily.
|
class |
StateBootstrapOperator<IN>
A
StreamOperator for executing StateBootstrapFunction 's. |
class |
StateBootstrapWrapperOperator<IN,OUT,OP extends AbstractStreamOperator<OUT> & OneInputStreamOperator<IN,OUT>>
Wraps an existing operator so it can be bootstrapped.
|
Modifier and Type | Class and Description |
---|---|
class |
HashSelector<IN>
Deprecated.
|
class |
KeyGroupRangePartitioner
Deprecated.
|
Modifier and Type | Class and Description |
---|---|
class |
BootstrapTransformationWithID<T>
Deprecated.
|
class |
MutableConfig
A utility for creating a mutable
Configuration from a ReadableConfig . |
class |
NeverFireProcessingTimeService
A processing time service whose timers never fire so all timers are included in savepoints.
|
class |
OperatorIDGenerator
Utility for generating Operator Id's from uid strings.
|
class |
SavepointEnvironment
A minimally implemented
Environment that provides the functionality required to run the
state-processor-api . |
class |
SavepointLoader
Utility class for loading
CheckpointMetadata metadata. |
class |
SavepointRuntimeContext
A streaming
RuntimeContext which delegates to the underlying batch RuntimeContext
along with a specified KeyedStateStore . |
class |
StateBootstrapTransformationWithID<T>
A simple container class that represents a newly bootstrapped operator state within savepoints.
|
class |
VoidTriggerable<K,N>
A
Triggerable that does nothing. |
Modifier and Type | Class and Description |
---|---|
class |
SavepointMetadata
Deprecated.
|
class |
SavepointMetadataV2
Savepoint metadata that can be modified.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractChangelogStateBackend
An abstract base implementation of the
StateBackend interface whose subclasses use
delegatedStateBackend and State changes to restore. |
class |
ChangelogKeyedStateBackend<K>
A
KeyedStateBackend that keeps state on the underlying delegated keyed state backend as
well as on the state change log. |
interface |
ChangelogState
State used by
ChangelogKeyedStateBackend . |
class |
ChangelogStateBackend
This state backend holds the working state in the underlying delegatedStateBackend, and forwards
state changes to State Changelog.
|
class |
DeactivatedChangelogStateBackend
This state backend use delegatedStateBackend and State changes to restore to the
delegatedStateBackend in which switching Changelog from enabled to disabled.
|
interface |
KvStateChangeLogger<Value,Namespace>
A logger for some key-partitioned state (not only
ValueState . |
interface |
StateChangeLogger<Value,Namespace>
Logs changes to a state created by
ChangelogKeyedStateBackend . |
class |
StateChangeOperation
The operation applied to
ChangelogState . |
Modifier and Type | Interface and Description |
---|---|
interface |
ChangelogApplierFactory
StateChangeApplier factory. |
class |
ChangelogBackendRestoreOperation
Restores
ChangelogKeyedStateBackend from the provided handles . |
interface |
ChangelogRestoreTarget<K>
Maintains metadata operation related to Changelog recovery.
|
class |
FunctionDelegationHelper
Delegating functions are used to create metadata on recovery when the
actual function code is not known yet. |
interface |
StateChangeApplier
Applies state data change to some state.
|
Modifier and Type | Class and Description |
---|---|
class |
ChangelogMaterializationMetricGroup
Metrics related to the materialization part of Changelog.
|
class |
PeriodicMaterializationManager
Stateless Materialization Manager.
|
Modifier and Type | Class and Description |
---|---|
class |
SimpleTimerService
Implementation of
TimerService that uses a InternalTimerService . |
Modifier and Type | Class and Description |
---|---|
class |
CommittableMessageSerializer<CommT>
The serializer to serialize
CommittableMessage s in custom operators. |
Modifier and Type | Class and Description |
---|---|
static class |
CoGroupedStreams.TaggedUnion<T1,T2>
Internal class for implementing tagged union co-group.
|
static class |
CoGroupedStreams.UnionSerializer<T1,T2>
|
Modifier and Type | Method and Description |
---|---|
static <T> DataStreamSink<T> |
DataStreamSink.forSink(DataStream<T> inputStream,
Sink<T> sink,
CustomSinkOperatorUidHashes customSinkOperatorUidHashes) |
static <T> DataStreamSink<T> |
DataStreamSink.forSinkV1(DataStream<T> inputStream,
Sink<T,?,?,?> sink,
CustomSinkOperatorUidHashes customSinkOperatorUidHashes) |
String |
CustomSinkOperatorUidHashes.getCommitterUidHash() |
String |
CustomSinkOperatorUidHashes.getGlobalCommitterUidHash() |
int |
DataStream.getId()
Returns the ID of the
DataStream in the current StreamExecutionEnvironment . |
KeySelector<T,KEY> |
KeyedStream.getKeySelector()
Gets the key selector that can get the key by which the stream if partitioned from the
elements.
|
TypeInformation<KEY> |
KeyedStream.getKeyType()
Gets the type of the key by which the stream is partitioned.
|
LegacySinkTransformation<T> |
DataStreamSink.getLegacyTransformation() |
Transformation<T> |
DataStream.getTransformation()
Returns the
Transformation that represents the operation that logically creates this
DataStream . |
Transformation<T> |
DataStreamSink.getTransformation()
Returns the transformation that contains the actual sink operator of this sink.
|
String |
CustomSinkOperatorUidHashes.getWriterUidHash() |
<R> SingleOutputStreamOperator<R> |
ConnectedStreams.process(CoProcessFunction<IN1,IN2,R> coProcessFunction,
TypeInformation<R> outputType)
Applies the given
CoProcessFunction on the connected input streams, thereby creating
a transformed output stream. |
<K,R> SingleOutputStreamOperator<R> |
ConnectedStreams.process(KeyedCoProcessFunction<K,IN1,IN2,R> keyedCoProcessFunction,
TypeInformation<R> outputType)
Applies the given
KeyedCoProcessFunction on the connected input streams, thereby
creating a transformed output stream. |
<R> SingleOutputStreamOperator<R> |
KeyedStream.process(KeyedProcessFunction<KEY,T,R> keyedProcessFunction,
TypeInformation<R> outputType)
Applies the given
KeyedProcessFunction on the input stream, thereby creating a
transformed output stream. |
<R> SingleOutputStreamOperator<R> |
DataStream.process(ProcessFunction<T,R> processFunction,
TypeInformation<R> outputType)
Applies the given
ProcessFunction on the input stream, thereby creating a transformed
output stream. |
<R> SingleOutputStreamOperator<R> |
KeyedStream.process(ProcessFunction<T,R> processFunction,
TypeInformation<R> outputType)
Deprecated.
|
<R> SingleOutputStreamOperator<R> |
WindowedStream.process(ProcessWindowFunction<T,R,K,W> function,
TypeInformation<R> resultType)
Applies the given window function to each window.
|
<R> SingleOutputStreamOperator<R> |
WindowedStream.reduce(ReduceFunction<T> reduceFunction,
ProcessWindowFunction<T,R,K,W> function,
TypeInformation<R> resultType)
Applies the given window function to each window.
|
Modifier and Type | Method and Description |
---|---|
void |
StreamExecutionEnvironment.addOperator(Transformation<?> transformation)
Adds an operator to the list of operators that should be executed when calling
StreamExecutionEnvironment.execute() . |
static boolean |
StreamExecutionEnvironment.areExplicitEnvironmentsAllowed()
Checks whether it is currently permitted to explicitly instantiate a LocalEnvironment or a
RemoteEnvironment.
|
<F> F |
StreamExecutionEnvironment.clean(F f)
Returns a "closure-cleaned" version of the given function.
|
JobExecutionResult |
StreamExecutionEnvironment.execute(StreamGraph streamGraph)
Triggers the program execution.
|
JobClient |
StreamExecutionEnvironment.executeAsync(StreamGraph streamGraph)
Triggers the program execution asynchronously.
|
StreamGraph |
StreamExecutionEnvironment.generateStreamGraph(List<Transformation<?>> transformations)
Generates a
StreamGraph that consists of the given transformations and is configured with the configuration of this environment. |
ReadableConfig |
StreamExecutionEnvironment.getConfiguration()
Gives read-only access to the underlying configuration of this environment.
|
InlineElement |
CheckpointConfig.ExternalizedCheckpointCleanup.getDescription() |
StreamGraph |
StreamExecutionEnvironment.getStreamGraph()
Getter of the
StreamGraph of the streaming job. |
StreamGraph |
StreamExecutionEnvironment.getStreamGraph(boolean clearTransformations)
Getter of the
StreamGraph of the streaming job with the option to clear previously
registered transformations . |
List<Transformation<?>> |
StreamExecutionEnvironment.getTransformations() |
void |
StreamExecutionEnvironment.invalidateClusterDataset(AbstractID datasetId) |
<T> void |
StreamExecutionEnvironment.registerCacheTransformation(AbstractID intermediateDataSetID,
CacheTransformation<T> t) |
void |
StreamExecutionEnvironment.registerCollectIterator(CollectResultIterator<?> iterator) |
Modifier and Type | Class and Description |
---|---|
class |
AggregationFunction<T>
Holder class for aggregation types that can be used on a windowed stream or keyed stream.
|
class |
ComparableAggregator<T>
An
AggregationFunction that computes values based on comparisons of Comparables . |
class |
Comparator
Internal comparator implementation, for use with
ComparableAggregator . |
class |
SumAggregator<T>
An
AggregationFunction that sums up fields. |
class |
SumFunction
Internal function for summing up contents of fields.
|
Modifier and Type | Class and Description |
---|---|
class |
DataStreamPythonFunction
DataStreamPythonFunction maintains the serialized python function which will be used in
BeamDataStreamPythonFunctionRunner. |
class |
DataStreamPythonFunctionInfo
DataStreamPythonFunctionInfo holds a PythonFunction and its function type. |
class |
KeyByKeySelector
KeyByKeySelector is responsible for extracting the first field of the input row as key. |
class |
PartitionCustomKeySelector
The
PartitionCustomKeySelector will return the first field of the input row value. |
Modifier and Type | Class and Description |
---|---|
class |
CustomTimestampAssigner<T>
TimestampAssigner which extracts timestamp from the second field of the input element.
|
class |
RemoveTimestampMapFunction<T>
MapFunction which removes the timestamp field from the input element.
|
Modifier and Type | Class and Description |
---|---|
class |
QueryableAppendingStateOperator<IN>
Internal operator handling queryable AppendingState instances.
|
class |
QueryableValueStateOperator<IN>
Internal operator handling queryable ValueState instances.
|
Modifier and Type | Class and Description |
---|---|
class |
SinkContextUtil
Utility for creating Sink
Contexts . |
static class |
TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>
State POJO class coupling pendingTransaction, context and pendingCommitTransactions.
|
static class |
TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>
Custom
TypeSerializer for the sink state. |
static class |
TwoPhaseCommitSinkFunction.StateSerializerConfigSnapshot<TXN,CONTEXT>
Deprecated.
this snapshot class is no longer in use, and is maintained only for backwards
compatibility purposes. It is fully replaced by
TwoPhaseCommitSinkFunction.StateSerializerSnapshot . |
static class |
TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>
Snapshot for the
TwoPhaseCommitSinkFunction.StateSerializer . |
static class |
TwoPhaseCommitSinkFunction.TransactionHolder<TXN>
Adds metadata (currently only the start time of the transaction) to the transaction object.
|
Modifier and Type | Class and Description |
---|---|
class |
Bucket<IN,BucketID>
A bucket is the directory organization of the output of the
StreamingFileSink . |
interface |
BucketFactory<IN,BucketID>
A factory able to create
buckets for the StreamingFileSink . |
interface |
BucketLifeCycleListener<IN,BucketID>
Listener about the status of
Bucket . |
class |
Buckets<IN,BucketID>
The manager of the different active buckets in the
StreamingFileSink . |
interface |
BucketWriter<IN,BucketID>
An interface for factories that create the different
writers . |
class |
BulkBucketWriter<IN,BucketID>
A factory that creates
BulkPartWriters . |
interface |
CompactingFileWriter
The file sink compactors use the
CompactingFileWriter to write a compacting file. |
static class |
CompactingFileWriter.Type
Enum defining the types of
CompactingFileWriter . |
class |
DefaultBucketFactoryImpl<IN,BucketID>
A factory returning
buckets . |
interface |
FileLifeCycleListener<BucketID>
Listener about the status of file.
|
interface |
InProgressFileWriter<IN,BucketID>
The
Bucket uses the InProgressFileWriter to write element to a part file. |
interface |
OutputStreamBasedCompactingFileWriter
The compactors use the
OutputStreamBasedCompactingFileWriter to directly write a
compacting file as an OutputStream . |
interface |
RecordWiseCompactingFileWriter<IN>
The compactors use the
RecordWiseCompactingFileWriter to write elements to a compacting
file. |
class |
RowWiseBucketWriter<IN,BucketID>
A factory that creates
RowWisePartWriters . |
class |
RowWisePartWriter<IN,BucketID>
A
InProgressFileWriter for row-wise formats that use an Encoder . |
static class |
StreamingFileSink.BucketsBuilder<IN,BucketID,T extends StreamingFileSink.BucketsBuilder<IN,BucketID,T>>
Deprecated.
The base abstract class for the
StreamingFileSink.RowFormatBuilder and StreamingFileSink.BulkFormatBuilder . |
class |
StreamingFileSinkHelper<IN>
Helper for
StreamingFileSink . |
class |
WriterProperties
This class describes the property of the
BucketWriter . |
Modifier and Type | Method and Description |
---|---|
abstract Buckets<IN,BucketID> |
StreamingFileSink.BucketsBuilder.createBuckets(int subtaskIndex) |
Buckets<IN,BucketID> |
StreamingFileSink.RowFormatBuilder.createBuckets(int subtaskIndex) |
Buckets<IN,BucketID> |
StreamingFileSink.BulkFormatBuilder.createBuckets(int subtaskIndex) |
abstract BucketWriter<IN,BucketID> |
StreamingFileSink.BucketsBuilder.createBucketWriter() |
BucketWriter<IN,BucketID> |
StreamingFileSink.RowFormatBuilder.createBucketWriter() |
BucketWriter<IN,BucketID> |
StreamingFileSink.BulkFormatBuilder.createBucketWriter() |
Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileMonitoringFunction<OUT>
This is the single (non-parallel) monitoring task which takes a
FileInputFormat and,
depending on the FileProcessingMode and the FilePathFilter , it is responsible
for:
Monitoring a user-provided path. |
class |
ContinuousFileReaderOperator<OUT,T extends TimestampedInputSplit>
The operator that reads the
splits received from the preceding
ContinuousFileMonitoringFunction . |
class |
FileMonitoringFunction
Deprecated.
Internal class deprecated in favour of
ContinuousFileMonitoringFunction . |
class |
FileReadFunction
Deprecated.
Internal class deprecated in favour of
ContinuousFileMonitoringFunction . |
class |
InputFormatSourceFunction<OUT>
A
SourceFunction that reads data using an InputFormat . |
Modifier and Type | Class and Description |
---|---|
class |
AggregateApplyAllWindowFunction<W extends Window,T,ACC,V,R>
|
class |
AggregateApplyWindowFunction<K,W extends Window,T,ACC,V,R>
|
class |
InternalProcessApplyAllWindowContext<IN,OUT,W extends Window>
Internal reusable context wrapper.
|
class |
InternalProcessApplyWindowContext<IN,OUT,KEY,W extends Window>
Internal reusable context wrapper.
|
class |
PassThroughAllWindowFunction<W extends Window,T>
A
AllWindowFunction that just emits each input element. |
class |
PassThroughWindowFunction<K,W extends Window,T>
A
WindowFunction that just emits each input element. |
class |
ReduceApplyAllWindowFunction<W extends Window,T,R>
Internal
AllWindowFunction that is used for implementing a fold on a window configuration
that only allows AllWindowFunction and cannot directly execute a ReduceFunction . |
class |
ReduceApplyProcessAllWindowFunction<W extends Window,T,R>
Internal
ProcessAllWindowFunction that is used for implementing a fold on a window
configuration that only allows AllWindowFunction and cannot directly execute a ReduceFunction . |
class |
ReduceApplyProcessWindowFunction<K,W extends Window,T,R>
Internal
ProcessWindowFunction that is used for implementing a fold on a window
configuration that only allows AllWindowFunction and cannot directly execute a ReduceFunction . |
class |
ReduceApplyWindowFunction<K,W extends Window,T,R>
Internal
WindowFunction that is used for implementing a fold on a window configuration
that only allows WindowFunction and cannot directly execute a ReduceFunction . |
Modifier and Type | Class and Description |
---|---|
class |
ArrayFromTuple
Converts a Tuple to an Object-Array.
|
class |
ConcatenatedExtract<FROM,OVER,TO>
Combines two extractors which will be executed one after each other.
|
interface |
Extractor<FROM,TO>
Extractors allow to extract/convert one type to another.
|
class |
FieldFromArray<OUT>
Extracts a single field out of an array.
|
class |
FieldFromTuple<OUT>
Extracts a single field out of a tuple.
|
class |
FieldsFromArray<OUT>
Extracts multiple fields from an array and puts them into a new array of the specified type.
|
class |
FieldsFromTuple
Extracts one or more fields of the type Double from a tuple and puts them into a new double[].
|
Modifier and Type | Class and Description |
---|---|
class |
GlobalStreamExchangeMode
This mode decides the default
ResultPartitionType of job edges. |
class |
JSONGenerator
Helper class for generating a JSON representation from a
StreamGraph . |
class |
NonChainedOutput
Used by operator chain and represents a non-chained output of the corresponding stream operator.
|
class |
SimpleTransformationTranslator<OUT,T extends Transformation<OUT>>
A base class for all
TransformationTranslators who translate
Transformations that have a single operator in their runtime
implementation. |
class |
StreamConfig
Internal configuration for a
StreamOperator . |
class |
StreamEdge
An edge in the streaming topology.
|
class |
StreamGraph
Class representing the streaming topology.
|
class |
StreamGraphGenerator
A generator that generates a
StreamGraph from a graph of Transformation s. |
class |
StreamingJobGraphGenerator
The StreamingJobGraphGenerator converts a
StreamGraph into a JobGraph . |
class |
StreamNode
Class representing the operators in the streaming programs, with all their properties.
|
interface |
TransformationTranslator<OUT,T extends Transformation<OUT>>
A
TransformationTranslator is responsible for translating a given Transformation
to its runtime implementation depending on the execution mode. |
static interface |
TransformationTranslator.Context
A context giving the necessary information for the translation of a given transformation.
|
Modifier and Type | Class and Description |
---|---|
class |
BatchGroupedReduceOperator<IN,KEY>
A
StreamOperator for executing a ReduceFunction on a KeyedStream in a RuntimeExecutionMode.BATCH
mode. |
interface |
CoordinatedOperatorFactory<OUT>
A factory class for the
StreamOperator s implementing OperatorEventHandler . |
interface |
InputFormatOperatorFactory<OUT>
Input format source operator factory.
|
interface |
InternalTimer<K,N>
Internal interface for in-flight timers.
|
interface |
InternalTimerService<N>
Interface for working with time and timers.
|
class |
InternalTimerServiceSerializationProxy<K>
Serialization proxy for the timer services for a given key-group.
|
class |
InternalTimersSnapshotReaderWriters
Readers and writers for different versions of the
InternalTimersSnapshot . |
interface |
InternalTimeServiceManager<K>
An entity keeping all the time-related services.
|
class |
InternalTimeServiceManagerImpl<K>
An entity keeping all the time-related services.
|
class |
KeyedProcessOperator<K,IN,OUT>
A
StreamOperator for executing KeyedProcessFunctions . |
class |
LegacyKeyedProcessOperator<K,IN,OUT>
Deprecated.
Replaced by
KeyedProcessOperator which takes KeyedProcessFunction |
interface |
OnWatermarkCallback<KEY>
A callback registered with the
InternalWatermarkCallbackService service. |
interface |
OutputFormatOperatorFactory<IN>
Interface for operator factories which create the sink operator containing an
OutputFormat . |
class |
ProcessOperator<IN,OUT>
A
StreamOperator for executing ProcessFunctions . |
class |
SimpleInputFormatOperatorFactory<OUT>
Input format source operator factory which just wrap existed
StreamSource . |
class |
SimpleOperatorFactory<OUT>
Simple factory which just wrap existed
StreamOperator . |
class |
SimpleOutputFormatOperatorFactory<IN>
A simple operator factory which create
StreamSink containing an OutputFormat . |
class |
SimpleUdfStreamOperatorFactory<OUT>
Udf stream operator factory which just wrap existed
AbstractUdfStreamOperator . |
class |
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.
|
class |
StreamFilter<IN>
A
StreamOperator for executing FilterFunctions . |
class |
StreamFlatMap<IN,OUT>
A
StreamOperator for executing FlatMapFunctions . |
class |
StreamGroupedReduceOperator<IN>
|
class |
StreamingRuntimeContext
Implementation of the
RuntimeContext , for streaming
operators. |
class |
StreamMap<IN,OUT>
A
StreamOperator for executing MapFunctions . |
class |
StreamOperatorStateHandler
Class encapsulating various state backend handling logic for
StreamOperator
implementations. |
class |
StreamProject<IN,OUT extends Tuple>
A
StreamOperator for executing projections on streams. |
class |
StreamSink<IN>
A
StreamOperator for executing SinkFunctions . |
class |
StreamSource<OUT,SRC extends SourceFunction<OUT>>
StreamOperator for streaming sources. |
class |
TimerHeapInternalTimer<K,N>
Implementation of
InternalTimer to use with a HeapPriorityQueueSet . |
class |
TimerSerializer<K,N>
A serializer for
TimerHeapInternalTimer objects that produces a serialization format that
is lexicographically aligned the priority of the timers. |
class |
TimerSerializerSnapshot<K,N>
Snapshot class for the
TimerSerializer . |
class |
TimestampedCollector<T>
|
interface |
Triggerable<K,N>
Interface for things that can be called by
InternalTimerService . |
interface |
UdfStreamOperatorFactory<OUT>
Udf stream operator factory.
|
Modifier and Type | Method and Description |
---|---|
protected boolean |
AbstractStreamOperatorV2.isUsingCustomRawKeyedState()
Indicates whether or not implementations of this class is writing to the raw keyed state
streams on snapshots, using
AbstractStreamOperatorV2.snapshotState(StateSnapshotContext) . |
protected boolean |
AbstractStreamOperator.isUsingCustomRawKeyedState()
Indicates whether or not implementations of this class is writing to the raw keyed state
streams on snapshots, using
AbstractStreamOperator.snapshotState(StateSnapshotContext) . |
Modifier and Type | Class and Description |
---|---|
class |
AsyncWaitOperator<IN,OUT>
The
AsyncWaitOperator allows to asynchronously process incoming stream records. |
Modifier and Type | Class and Description |
---|---|
class |
OrderedStreamElementQueue<OUT>
Ordered
StreamElementQueue implementation. |
interface |
StreamElementQueue<OUT>
Interface for stream element queues for the
AsyncWaitOperator . |
class |
UnorderedStreamElementQueue<OUT>
Unordered implementation of the
StreamElementQueue . |
Modifier and Type | Class and Description |
---|---|
class |
ClientAndIterator<E>
|
class |
CollectSinkFunction<IN>
A sink function that collects query results and sends them back to the client.
|
class |
CollectStreamSink<T>
A
DataStreamSink which is used to collect results of a data stream. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonFunctionOperator<OUT>
Base class for all stream operators to execute Python functions.
|
interface |
DataStreamPythonFunctionOperator<OUT>
Interface for Python DataStream operators.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractEmbeddedDataStreamPythonFunctionOperator<OUT>
Base class for all Python DataStream operators executed in embedded Python environment.
|
class |
AbstractEmbeddedPythonFunctionOperator<OUT>
Abstract class for all stream operators to execute Python functions in embedded Python
environment.
|
class |
AbstractOneInputEmbeddedPythonFunctionOperator<IN,OUT>
AbstractOneInputEmbeddedPythonFunctionOperator is responsible for run Python DataStream
operators with one input in Embedded Python environment. |
class |
AbstractTwoInputEmbeddedPythonFunctionOperator<IN1,IN2,OUT>
AbstractTwoInputEmbeddedPythonFunctionOperator is responsible for run Python DataStream
operators with two input user defined python function in Embedded Python environment. |
class |
EmbeddedPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>
The
EmbeddedPythonBatchCoBroadcastProcessOperator is responsible for executing the Python
CoBroadcastProcess Function under BATCH mode, EmbeddedPythonCoProcessOperator is used
under STREAMING mode. |
class |
EmbeddedPythonBatchKeyedCoBroadcastProcessOperator<K,IN1,IN2,OUT>
The
EmbeddedPythonBatchKeyedCoBroadcastProcessOperator is responsible for executing the
Python CoBroadcastProcess function under BATCH mode, EmbeddedPythonKeyedCoProcessOperator
is used under STREAMING mode. |
class |
EmbeddedPythonCoProcessOperator<IN1,IN2,OUT>
EmbeddedPythonCoProcessOperator is responsible for executing Python CoProcessFunction in
embedded Python environment. |
class |
EmbeddedPythonKeyedCoProcessOperator<K,IN1,IN2,OUT>
EmbeddedPythonKeyedCoProcessOperator is responsible for executing user defined python
KeyedCoProcessFunction in embedded Python environment. |
class |
EmbeddedPythonKeyedProcessOperator<K,IN,OUT>
EmbeddedPythonKeyedProcessOperator is responsible for executing user defined python
KeyedProcessFunction in embedded Python environment. |
class |
EmbeddedPythonProcessOperator<IN,OUT>
EmbeddedPythonProcessOperator is responsible for executing Python ProcessFunction in
embedded Python environment. |
class |
EmbeddedPythonWindowOperator<K,IN,OUT,W extends Window>
EmbeddedPythonWindowOperator is responsible for executing user defined python
ProcessWindowFunction in embedded Python environment. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractExternalDataStreamPythonFunctionOperator<OUT>
Base class for all Python DataStream operators executed in Python process.
|
class |
AbstractExternalOneInputPythonFunctionOperator<IN,OUT>
AbstractExternalOneInputPythonFunctionOperator is responsible for launching beam runner
which will start a python harness to execute user defined python function. |
class |
AbstractExternalPythonFunctionOperator<OUT>
Abstract class for all stream operators to execute Python functions in external environment.
|
class |
AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>
AbstractExternalTwoInputPythonFunctionOperator is responsible for launching beam runner
which will start a python harness to execute two-input user defined python function. |
class |
ExternalPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>
The
ExternalPythonBatchCoBroadcastProcessOperator is responsible for executing the Python
CoBroadcastProcess Function under BATCH mode, ExternalPythonCoProcessOperator is used
under STREAMING mode. |
class |
ExternalPythonBatchKeyedCoBroadcastProcessOperator<OUT>
The
ExternalPythonBatchKeyedCoBroadcastProcessOperator is responsible for executing the
Python CoBroadcastProcess function under BATCH mode, ExternalPythonKeyedCoProcessOperator
is used under STREAMING mode. |
class |
ExternalPythonCoProcessOperator<IN1,IN2,OUT>
The
ExternalPythonCoProcessOperator is responsible for executing the Python CoProcess
Function. |
class |
ExternalPythonKeyedCoProcessOperator<OUT>
ExternalPythonKeyedCoProcessOperator is responsible for launching beam runner which will
start a python harness to execute user defined python CoProcess function. |
class |
ExternalPythonKeyedProcessOperator<OUT>
ExternalPythonKeyedProcessOperator is responsible for launching beam runner which will
start a python harness to execute user defined python function. |
class |
ExternalPythonProcessOperator<IN,OUT>
ExternalPythonProcessOperator is responsible for launching beam runner which will start a
python harness to execute user defined python ProcessFunction. |
Modifier and Type | Class and Description |
---|---|
class |
RunnerOutputCollector<OUT>
Output collector for Python UDF runner.
|
Modifier and Type | Class and Description |
---|---|
class |
TimerHandler
Utilities to handle triggered timer.
|
class |
TimerRegistration
Handles the interaction with the Python worker for registering and deleting timers.
|
class |
TimerUtils
Utilities for timer.
|
Modifier and Type | Class and Description |
---|---|
class |
NoOpTimestampsAndWatermarks<T>
An implementation of
TimestampsAndWatermarks where all watermarking/event-time operations
are no-ops. |
class |
ProgressiveTimestampsAndWatermarks<T>
An implementation of
TimestampsAndWatermarks that does periodic watermark emission and
keeps track of watermarks on a per-split basis. |
class |
SourceOutputWithWatermarks<T>
Implementation of the SourceOutput.
|
interface |
TimestampsAndWatermarks<T>
Basic interface for the timestamp extraction and watermark generation logic for the
SourceReader . |
static interface |
TimestampsAndWatermarks.WatermarkUpdateListener
Lets the owner/creator of the output know about latest emitted watermark.
|
class |
TimestampsAndWatermarksContext
A simple implementation of a context that is both
TimestampAssignerSupplier.Context and
WatermarkGeneratorSupplier.Context . |
class |
WatermarkToDataOutput
An adapter that exposes a
WatermarkOutput based on a PushingAsyncDataInput.DataOutput . |
Modifier and Type | Class and Description |
---|---|
class |
BeamDataStreamPythonFunctionRunner
BeamDataStreamPythonFunctionRunner is responsible for starting a beam python harness to
execute user defined python function. |
class |
BeamPythonFunctionRunner
A
BeamPythonFunctionRunner used to execute Python functions. |
class |
PythonSharedResources
The set of resources that can be shared by all the Python operators in a slot.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractBroadcastStateTransformation<IN1,IN2,OUT>
Base class for Broadcast State transformations.
|
class |
AbstractMultipleInputTransformation<OUT>
Base class for transformations representing the application of a
MultipleInputStreamOperator to input Transformations . |
class |
BroadcastStateTransformation<IN1,IN2,OUT>
A non-keyed
AbstractBroadcastStateTransformation . |
class |
CacheTransformation<T>
When in batch mode, the
CacheTransformation represents the intermediate result of the
upper stream should be cached when it is computed at the first time. |
class |
CoFeedbackTransformation<F>
This represents a feedback point in a topology.
|
class |
FeedbackTransformation<T>
This represents a feedback point in a topology.
|
class |
KeyedBroadcastStateTransformation<KEY,IN1,IN2,OUT>
A keyed
AbstractBroadcastStateTransformation . |
class |
KeyedMultipleInputTransformation<OUT>
AbstractMultipleInputTransformation implementation for keyed streams. |
class |
LegacySinkTransformation<T>
This Transformation represents a stream Sink.
|
class |
LegacySourceTransformation<T>
This represents a Source.
|
class |
MultipleInputTransformation<OUT>
AbstractMultipleInputTransformation implementation for non-keyed streams. |
class |
OneInputTransformation<IN,OUT>
This Transformation represents the application of a
OneInputStreamOperator to one input Transformation . |
class |
PartitionTransformation<T>
This transformation represents a change of partitioning of the input elements.
|
class |
PhysicalTransformation<T>
A
Transformation that creates a physical operation. |
class |
ReduceTransformation<IN,K>
A
Transformation that describes a reduce operation on a KeyedStream . |
class |
SinkTransformation<InputT,OutputT>
A
Transformation for Sink . |
class |
SinkV1Adapter<InputT,CommT,WriterStateT,GlobalCommT>
Translates Sink V1 into Sink V2.
|
class |
SinkV1Adapter.GlobalCommitterAdapter
Simulate the global committer behaviour with a committer.
|
class |
SourceTransformation<OUT,SplitT extends SourceSplit,EnumChkT>
A
PhysicalTransformation for Source . |
class |
StreamExchangeMode
The data exchange mode between operators during
StreamGraph generation. |
class |
TimestampsAndWatermarksTransformation<IN>
|
class |
TwoInputTransformation<IN1,IN2,OUT>
This Transformation represents the application of a
TwoInputStreamOperator to two input
Transformations . |
class |
UnionTransformation<T>
This transformation represents a union of several input
Transformations . |
interface |
WithBoundedness
An interface to be implemented by transformations that have explicitly set
Boundedness . |
Modifier and Type | Class and Description |
---|---|
class |
PythonBroadcastStateTransformation<IN1,IN2,OUT>
A
Transformation representing a Python Co-Broadcast-Process operation, which will be
translated into different operations by PythonBroadcastStateTransformationTranslator . |
class |
PythonKeyedBroadcastStateTransformation<OUT>
A
Transformation representing a Python Keyed-Co-Broadcast-Process operation, which will
be translated into different operations by PythonKeyedBroadcastStateTransformationTranslator . |
Modifier and Type | Class and Description |
---|---|
class |
PickledByteArrayTypeInfo
A PickledByteArrayTypeInfo indicates that the data of this type is a generated primitive byte
array by pickle.
|
Modifier and Type | Class and Description |
---|---|
class |
ByteArrayWrapper
A wrapper of the byte array.
|
class |
ByteArrayWrapperSerializer
The serializer of
ByteArrayWrapper . |
class |
PythonOperatorUtils
Utilities used by Python operators.
|
class |
PythonTypeUtils
A util class for converting the given TypeInformation to other objects.
|
Modifier and Type | Class and Description |
---|---|
static class |
GlobalWindows.NeverTrigger
A trigger that never fires, as default Trigger for GlobalWindows.
|
Modifier and Type | Class and Description |
---|---|
class |
NoOpCassandraFailureHandler
A
CassandraFailureHandler that simply fails the sink on any failures. |
Modifier and Type | Interface and Description |
---|---|
interface |
ElasticsearchApiCallBridge<C extends AutoCloseable>
An
ElasticsearchApiCallBridge is used to bridge incompatible Elasticsearch Java API calls
across different versions. |
class |
ElasticsearchSinkBase<T,C extends AutoCloseable>
Base class for all Flink Elasticsearch Sinks.
|
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch6DynamicSinkFactory
A
DynamicTableSinkFactory for discovering Elasticsearch6DynamicSink . |
class |
Elasticsearch7DynamicSinkFactory
A
DynamicTableSinkFactory for discovering Elasticsearch7DynamicSink . |
class |
IndexGeneratorBase
Base class for
IndexGenerator . |
Modifier and Type | Class and Description |
---|---|
class |
IgnoringFailureHandler
Ignores all kinds of failures and drops the affected
ActionRequest . |
class |
NoOpFailureHandler
An
ActionRequestFailureHandler that simply fails the sink on any failures. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch6ApiCallBridge
Implementation of
ElasticsearchApiCallBridge for Elasticsearch 6 and later versions. |
Modifier and Type | Class and Description |
---|---|
class |
Elasticsearch7ApiCallBridge
Implementation of
ElasticsearchApiCallBridge for Elasticsearch 7 and later versions. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaConsumerBase<T>
Base class of all Flink Kafka Consumer data sources.
|
static class |
FlinkKafkaProducer.ContextStateSerializer
Deprecated.
|
static class |
FlinkKafkaProducer.KafkaTransactionContext
Deprecated.
Context associated to this instance of the
FlinkKafkaProducer . |
static class |
FlinkKafkaProducer.KafkaTransactionState
Deprecated.
State for handling transactions.
|
static class |
FlinkKafkaProducer.NextTransactionalIdHintSerializer
Deprecated.
|
static class |
FlinkKafkaProducer.TransactionStateSerializer
Deprecated.
|
class |
FlinkKafkaProducerBase<IN>
Flink Sink to produce data into a Kafka topic.
|
Modifier and Type | Class and Description |
---|---|
class |
OffsetCommitMode
The offset commit mode represents the behaviour of how offsets are externally committed back to
Kafka brokers / Zookeeper.
|
class |
OffsetCommitModes
Utilities for
OffsetCommitMode . |
class |
StartupMode
Startup modes for the Kafka Consumer.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractFetcher<T,KPH>
Base class for all fetchers, which implement the connections to Kafka brokers and pull records
from Kafka partitions.
|
class |
AbstractPartitionDiscoverer
Base class for all partition discoverers.
|
class |
ClosableBlockingQueue<E>
A special form of blocking queue with two additions:
The queue can be closed atomically when empty.
|
class |
ExceptionProxy
A proxy that communicates exceptions between threads.
|
class |
Handover
The Handover is a utility to hand over data (a buffer of records) and exception from a
producer thread to a consumer thread.
|
interface |
KafkaCommitCallback
A callback interface that the source operator can implement to trigger custom actions when a
commit request completes, which should normally be triggered from checkpoint complete event.
|
class |
KafkaConsumerThread<T>
The thread the runs the
KafkaConsumer , connecting to the brokers and polling records. |
class |
KafkaDeserializationSchemaWrapper<T>
A simple wrapper for using the DeserializationSchema with the KafkaDeserializationSchema
interface.
|
class |
KafkaFetcher<T>
A fetcher that fetches data from Kafka brokers via the Kafka consumer API.
|
class |
KafkaPartitionDiscoverer
A partition discoverer that can be used to discover topics and partitions metadata from Kafka
brokers via the Kafka high-level consumer API.
|
class |
KafkaSerializationSchemaWrapper<T>
An adapter from old style interfaces such as
SerializationSchema , FlinkKafkaPartitioner to the KafkaSerializationSchema . |
class |
KafkaShuffleFetcher<T>
Fetch data from Kafka for Kafka Shuffle.
|
class |
KafkaTopicPartitionAssigner
Utility for assigning Kafka partitions to consumer subtasks.
|
class |
KafkaTopicPartitionLeader
Serializable Topic Partition info with leader Node information.
|
class |
KafkaTopicPartitionState<T,KPH>
The state that the Flink Kafka Consumer holds for each Kafka partition.
|
class |
KafkaTopicPartitionStateSentinel
Magic values used to represent special offset states before partitions are actually read.
|
class |
KafkaTopicPartitionStateWithWatermarkGenerator<T,KPH>
A special version of the per-kafka-partition-state that additionally holds a
TimestampAssigner , WatermarkGenerator , an immediate WatermarkOutput , and a
deferred WatermarkOutput for this partition. |
class |
KafkaTopicsDescriptor
A Kafka Topics Descriptor describes how the consumer subscribes to Kafka topics - either a fixed
list of topics, or a topic pattern.
|
class |
KeyedSerializationSchemaWrapper<T>
A simple wrapper for using the SerializationSchema with the KeyedSerializationSchema interface.
|
class |
TransactionalIdsGenerator
Class responsible for generating transactional ids to use when communicating with Kafka.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaConsumerMetricConstants
A collection of Kafka consumer metrics related constant strings.
|
class |
KafkaMetricMutableWrapper
Gauge for getting the current value of a Kafka metric.
|
class |
KafkaMetricWrapper
Gauge for getting the current value of a Kafka metric.
|
Modifier and Type | Class and Description |
---|---|
class |
FlinkKafkaShuffleConsumer<T>
Flink Kafka Shuffle Consumer Function.
|
class |
FlinkKafkaShuffleProducer<IN,KEY>
Flink Kafka Shuffle Producer Function.
|
Modifier and Type | Class and Description |
---|---|
class |
KafkaDynamicSink
A version-agnostic Kafka
DynamicTableSink . |
class |
KafkaDynamicSource
A version-agnostic Kafka
ScanTableSource . |
class |
KafkaDynamicTableFactory
Factory for creating configured instances of
KafkaDynamicSource and KafkaDynamicSink . |
Modifier and Type | Class and Description |
---|---|
class |
FlinkKinesisException
A
RuntimeException wrapper indicating the exception was thrown from this connector. |
static class |
FlinkKinesisException.FlinkKinesisTimeoutException
A semantic
RuntimeException thrown to indicate timeout errors in the Kinesis
connector. |
Modifier and Type | Class and Description |
---|---|
class |
KinesisDataFetcher<T>
A KinesisDataFetcher is responsible for fetching data from multiple Kinesis shards.
|
class |
ShardConsumer<T>
Thread that subscribes to the given
RecordPublisher . |
Modifier and Type | Class and Description |
---|---|
class |
RecordBatch
A batch of UserRecords received from Kinesis.
|
interface |
RecordPublisher
A
RecordPublisher will consume records from an external stream and deliver them to the
registered subscriber. |
interface |
RecordPublisherFactory
A factory interface used to create instances of
RecordPublisher . |
Modifier and Type | Class and Description |
---|---|
class |
FanOutRecordPublisher
A
RecordPublisher that will read and forward records from Kinesis using EFO, to the
subscriber. |
class |
FanOutRecordPublisherFactory
A
RecordPublisher factory used to create instances of FanOutRecordPublisher . |
class |
FanOutShardSubscriber
This class is responsible for acquiring an Enhanced Fan Out subscription and consuming records
from a shard.
|
class |
StreamConsumerRegistrar
Responsible for registering and deregistering EFO stream consumers.
|
Modifier and Type | Class and Description |
---|---|
class |
AdaptivePollingRecordPublisher
An adaptive record publisher to add a dynamic batch read size for
PollingRecordPublisher . |
class |
PollingRecordPublisher
A
RecordPublisher that will read records from Kinesis and forward them to the subscriber. |
class |
PollingRecordPublisherConfiguration
A configuration class for
PollingRecordPublisher instantiated from a properties map. |
class |
PollingRecordPublisherFactory
A
RecordPublisher factory used to create instances of PollingRecordPublisher . |
Modifier and Type | Class and Description |
---|---|
class |
KinesisConsumerMetricConstants
A collection of consumer metric related constant names.
|
class |
PollingRecordPublisherMetricsReporter
A container for
PollingRecordPublisher s to report metric values. |
class |
ShardConsumerMetricsReporter
A container for
ShardConsumer s to report metric values. |
Modifier and Type | Class and Description |
---|---|
class |
KinesisStreamShard
Deprecated.
Will be remove in a future version in favor of
StreamShardHandle . |
class |
KinesisStreamShardState
A wrapper class that bundles a
StreamShardHandle with its last processed sequence number. |
class |
SentinelSequenceNumber
Special flag values for sequence numbers in shards to indicate special positions.
|
class |
SequenceNumber
A serializable representation of a Kinesis record's sequence number.
|
class |
StartingPosition
The position in which to start consuming from a stream.
|
class |
StreamShardHandle
A wrapper class around the information provided along with streamName and
Shard , with some extra utility methods to determine whether
or not a shard is closed and whether or not the shard is a result of parent shard splits or
merges. |
class |
StreamShardMetadata
A serializable representation of a AWS Kinesis Stream shard.
|
Modifier and Type | Class and Description |
---|---|
class |
FullJitterBackoff
Used to calculate full jitter backoff sleep durations.
|
class |
GetShardListResult
Basic model class to bundle the shards retrieved from Kinesis on a
KinesisProxyInterface.getShardList(Map) call. |
class |
KinesisProxy
Kinesis proxy implementation - a utility class that is used as a proxy to make calls to AWS
Kinesis for several functions, such as getting a list of shards and fetching a batch of data
records starting from a specified record sequence number.
|
interface |
KinesisProxyInterface
Interface for a Kinesis proxy that operates on multiple Kinesis streams within the same AWS
service region.
|
class |
KinesisProxyV2
Kinesis proxy implementation using AWS SDK v2.x - a utility class that is used as a proxy to make
calls to AWS Kinesis for several EFO (Enhanced Fan Out) functions, such as de-/registering stream
consumers, subscribing to a shard and receiving records from a shard.
|
class |
KinesisProxyV2Factory
Creates instances of
KinesisProxyV2 . |
interface |
KinesisProxyV2Interface
Interface for a Kinesis proxy using AWS SDK v2.x operating on multiple Kinesis streams within the
same AWS service region.
|
Modifier and Type | Class and Description |
---|---|
class |
KinesisDeserializationSchemaWrapper<T>
A simple wrapper for using the
DeserializationSchema with the KinesisDeserializationSchema interface. |
Modifier and Type | Class and Description |
---|---|
class |
KinesisConnectorOptionsUtil
Class for handling kinesis table options, including key mapping and validations and property
extraction.
|
class |
KinesisDynamicSource
Kinesis-backed
ScanTableSource . |
class |
KinesisDynamicTableFactory
Factory for creating
KinesisDynamicSource . |
class |
RowDataKinesisDeserializationSchema
A
KinesisDeserializationSchema adaptor for RowData records that delegates
physical data deserialization to an inner DeserializationSchema and appends requested
metadata to the end of the deserialized RowData record. |
Modifier and Type | Class and Description |
---|---|
class |
AWSUtil
Some utilities specific to Amazon Web Service.
|
class |
AwsV2Util
Utility methods specific to Amazon Web Service SDK v2.x.
|
class |
KinesisConfigUtil
Utilities for Flink Kinesis connector configuration.
|
class |
RecordEmitter<T extends TimestampedValue>
Emitter that handles event time synchronization between producer threads.
|
class |
StreamConsumerRegistrarUtil
A utility class that creates instances of
StreamConsumerRegistrar and handles batch
operations. |
static class |
StreamConsumerRegistrarUtil.FlinkKinesisStreamConsumerRegistrarException
A semantic
RuntimeException thrown to indicate errors de-/registering stream
consumers. |
class |
TimeoutLatch
Internal use.
|
Modifier and Type | Class and Description |
---|---|
class |
BlockingQueueBroker
Broker for the BlockingQueue used in StreamIterationHead and StreamIterationTail for implementing feedback streams. |
class |
DataInputStatus
It is an internal equivalent of
InputStatus that provides
additional non public statuses. |
class |
InputGateUtil
Utility for dealing with input gates.
|
class |
MultipleFuturesAvailabilityHelper
This class is semi-thread safe.
|
class |
MultipleInputSelectionHandler
This handler is mainly used for selecting the next available input index in
StreamMultipleInputProcessor . |
interface |
PushingAsyncDataInput<T>
The variant of
PullingAsyncDataInput that is defined for handling both network input and
source input in a unified way via PushingAsyncDataInput.emitNext(DataOutput) instead of returning Optional.empty() via PullingAsyncDataInput.pollNext() . |
class |
RecordWriterOutput<OUT>
Implementation of
Output that sends data using a RecordWriter . |
interface |
StreamInputProcessor
Interface for processing records by
StreamTask . |
class |
StreamMultipleInputProcessor
Input processor for
MultipleInputStreamOperator . |
class |
StreamMultipleInputProcessorFactory
A factory for
StreamMultipleInputProcessor . |
class |
StreamOneInputProcessor<IN>
Input reader for
OneInputStreamTask . |
interface |
StreamTaskInput<T>
Basic interface for inputs of stream operators.
|
class |
StreamTaskNetworkInput<T>
Implementation of
StreamTaskInput that wraps an input from network taken from CheckpointedInputGate . |
class |
StreamTaskSourceInput<T>
Implementation of
StreamTaskInput that reads data from the SourceOperator and
returns the DataInputStatus to indicate whether the source state is available,
unavailable or finished. |
Modifier and Type | Class and Description |
---|---|
class |
BarrierAlignmentUtil
Utility for barrier alignment.
|
class |
CheckpointBarrierTracker
The
CheckpointBarrierTracker keeps track of what checkpoint barriers have been received
from which input channels. |
class |
CheckpointedInputGate
The
CheckpointedInputGate uses CheckpointBarrierHandler to handle incoming CheckpointBarrier from the InputGate . |
class |
InputProcessorUtil
Utility for creating
CheckpointedInputGate based on checkpoint mode for StreamOneInputProcessor . |
class |
SingleCheckpointBarrierHandler
SingleCheckpointBarrierHandler is used for triggering checkpoint while reading the first
barrier and keeping track of the number of received barriers and consumed barriers. |
interface |
UpstreamRecoveryTracker
Tracks status of upstream channels while they recover.
|
Modifier and Type | Class and Description |
---|---|
class |
RescalingStreamTaskNetworkInput<T>
A
StreamTaskNetworkInput implementation that demultiplexes virtual channels. |
Modifier and Type | Class and Description |
---|---|
class |
CommitterOperatorFactory<CommT>
A
StreamOperatorFactory for CommitterOperator . |
class |
SinkWriterOperatorFactory<InputT,CommT>
A
StreamOperatorFactory for SinkWriterOperator . |
Modifier and Type | Interface and Description |
---|---|
interface |
CheckpointCommittableManager<CommT>
This interface adds checkpoint meta information to the committable.
|
class |
CommitRequestImpl<CommT>
Internal implementation to commit a specific committable and handle the response.
|
class |
CommitRequestState
Internal state of a committable.
|
class |
CommittableCollector<CommT>
This class is responsible to book-keep the committing progress across checkpoints and subtasks.
|
class |
CommittableCollectorSerializer<CommT>
The serializer for the
CommittableCollector . |
interface |
CommittableManager<CommT>
Internal wrapper to handle the committing of committables.
|
class |
SinkV1CommittableDeserializer
This class offers the possibility to deserialize committables that have been written with older
Flink releases (i.e.
|
Modifier and Type | Class and Description |
---|---|
class |
AssignerWithPeriodicWatermarksAdapter<T>
An adapter that wraps a
AssignerWithPeriodicWatermarks into a WatermarkGenerator . |
class |
AssignerWithPunctuatedWatermarksAdapter<T>
An adapter that wraps a
AssignerWithPunctuatedWatermarks into a WatermarkGenerator . |
Modifier and Type | Class and Description |
---|---|
class |
EvictingWindowOperator<K,IN,OUT,W extends Window>
A
WindowOperator that also allows an Evictor to be used. |
class |
KeyMap<K,V>
A special Hash Map implementation that can be traversed efficiently in sync with other hash maps.
|
class |
WindowOperator<K,IN,ACC,OUT,W extends Window>
An operator that implements the logic for windowing based on a
WindowAssigner and Trigger . |
Modifier and Type | Class and Description |
---|---|
class |
InternalProcessAllWindowContext<IN,OUT,W extends Window>
Internal reusable context wrapper.
|
class |
InternalProcessWindowContext<IN,OUT,KEY,W extends Window>
Internal reusable context wrapper.
|
Modifier and Type | Class and Description |
---|---|
class |
BroadcastPartitioner<T>
Partitioner that selects all the output channels.
|
class |
CustomPartitionerWrapper<K,T>
Partitioner that selects the channel with a user defined partitioner function on a key.
|
class |
ForwardForConsecutiveHashPartitioner<T>
If there are multiple consecutive and the same hash shuffles, SQL planner will change them except
the first one to use forward partitioner, so that these operators can be chained to reduce
unnecessary shuffles.
|
class |
ForwardForUnspecifiedPartitioner<T>
When the parallelism of both upstream and downstream is
ExecutionConfig.PARALLELISM_DEFAULT and the edge's partitioner is not specified
(partitioner==null), the edge's partitioner will be set to FORWARD by default(See StreamGraph.createActualEdge(java.lang.Integer, java.lang.Integer, int, org.apache.flink.streaming.runtime.partitioner.StreamPartitioner<?>, org.apache.flink.util.OutputTag, org.apache.flink.streaming.api.transformations.StreamExchangeMode, org.apache.flink.runtime.jobgraph.IntermediateDataSetID) method for details). |
class |
ForwardPartitioner<T>
Partitioner that forwards elements only to the locally running downstream operation.
|
class |
GlobalPartitioner<T>
Partitioner that sends all elements to the downstream operator with subtask ID=0.
|
class |
KeyGroupStreamPartitioner<T,K>
Partitioner selects the target channel based on the key group index.
|
class |
RebalancePartitioner<T>
Partitioner that distributes the data equally by cycling through the output channels.
|
class |
RescalePartitioner<T>
Partitioner that distributes the data equally by cycling through the output channels.
|
class |
ShufflePartitioner<T>
Partitioner that distributes the data equally by selecting one output channel randomly.
|
class |
StreamPartitioner<T>
A special
ChannelSelector for use in streaming programs. |
Modifier and Type | Class and Description |
---|---|
class |
StreamElement
An element in a data stream.
|
class |
StreamElementSerializer<T>
|
class |
StreamRecord<T>
One value in a data stream.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractTwoInputStreamTask<IN1,IN2,OUT>
Abstract class for executing a
TwoInputStreamOperator . |
interface |
ContainingTaskDetails
Details about the operator containing task (such as
StreamTask ). |
class |
ExceptionInChainedOperatorException
A special exception that signifies that the cause exception came from a chained operator.
|
class |
FinishedOperatorChain<OUT,OP extends StreamOperator<OUT>>
The
OperatorChain that is used for restoring tasks that are TaskStateManager.isTaskDeployedAsFinished() . |
class |
MultipleInputStreamTask<OUT>
A
StreamTask for executing a MultipleInputStreamOperator and supporting the
MultipleInputStreamOperator to select input for reading. |
class |
OneInputStreamTask<IN,OUT>
A
StreamTask for executing a OneInputStreamOperator . |
class |
OperatorEventDispatcherImpl
An implementation of the
OperatorEventDispatcher . |
interface |
ProcessingTimeServiceFactory
A factory for creating processing time services with a given
MailboxExecutor . |
class |
ProcessingTimeServiceUtil
Utility for classes that implements the
ProcessingTimeService interface. |
class |
RegularOperatorChain<OUT,OP extends StreamOperator<OUT>>
A regular non finished on restore
OperatorChain . |
class |
SourceOperatorStreamTask<T>
A subclass of
StreamTask for executing the SourceOperator . |
class |
SourceStreamTask<OUT,SRC extends SourceFunction<OUT>,OP extends StreamSource<OUT,SRC>>
StreamTask for executing a StreamSource . |
class |
StreamIterationHead<OUT>
A special
StreamTask that is used for executing feedback edges. |
class |
StreamIterationTail<IN>
A special
StreamTask that is used for executing feedback edges. |
class |
StreamOperatorWrapper<OUT,OP extends StreamOperator<OUT>>
This class handles the finish, endInput and other related logic of a
StreamOperator . |
class |
StreamTask<OUT,OP extends StreamOperator<OUT>>
Base class for all streaming tasks.
|
interface |
StreamTaskActionExecutor
|
class |
StreamTaskException
An exception that is thrown by the stream vertices when encountering an illegal condition.
|
interface |
SubtaskCheckpointCoordinator
Coordinates checkpointing-related work for a subtask (i.e.
|
class |
SystemProcessingTimeService
A
TimerService which assigns as current processing time the result of calling System.currentTimeMillis() and registers timers using a ScheduledThreadPoolExecutor . |
class |
TimerException
RuntimeException for wrapping exceptions that are thrown in the timer callback of the
timer service in StreamTask . |
interface |
TimerService
A common timer service interface with life cycle methods.
|
class |
TwoInputStreamTask<IN1,IN2,OUT>
A
StreamTask for executing a TwoInputStreamOperator and supporting the TwoInputStreamOperator to select input for reading. |
Modifier and Type | Class and Description |
---|---|
class |
Mail
An executable bound to a specific operator in the chain, such that it can be picked for
downstream mailbox.
|
interface |
MailboxDefaultAction
Interface for the default action that is repeatedly invoked in the mailbox-loop.
|
static interface |
MailboxDefaultAction.Controller
This controller is a feedback interface for the default action to interact with the mailbox
execution.
|
static interface |
MailboxDefaultAction.Suspension
Represents the suspended state of a
MailboxDefaultAction , ready to resume. |
interface |
MailboxExecutorFactory
A factory for creating mailbox executors with a given priority.
|
class |
MailboxExecutorImpl
Implementation of an executor service build around a mailbox-based execution model.
|
class |
MailboxMetricsController
Mailbox metrics controller class.
|
class |
MailboxProcessor
This class encapsulates the logic of the mailbox-based execution model.
|
interface |
TaskMailbox
A task mailbox provides read and write access to a mailbox and has a lifecycle of open ->
(quiesced) -> closed.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonBroadcastStateTransformationTranslator<IN1,IN2,OUT>
A
TransformationTranslator that translates PythonBroadcastStateTransformation into ExternalPythonCoProcessOperator /EmbeddedPythonCoProcessOperator in streaming mode or ExternalPythonBatchCoBroadcastProcessOperator /EmbeddedPythonBatchCoBroadcastProcessOperator in batch mode. |
class |
PythonKeyedBroadcastStateTransformationTranslator<OUT>
A
TransformationTranslator that translates PythonKeyedBroadcastStateTransformation into ExternalPythonKeyedCoProcessOperator /EmbeddedPythonKeyedCoProcessOperator in streaming mode or ExternalPythonBatchKeyedCoBroadcastProcessOperator /EmbeddedPythonBatchKeyedCoBroadcastProcessOperator in batch mode. |
Modifier and Type | Class and Description |
---|---|
class |
StatusWatermarkValve
A
StatusWatermarkValve embodies the logic of how Watermark and WatermarkStatus are propagated to downstream outputs, given a set of one or multiple input
channels that continuously receive them. |
class |
WatermarkStatus
A Watermark Status element informs stream tasks whether or not they should continue to expect
watermarks from the input stream that sent them.
|
Modifier and Type | Class and Description |
---|---|
class |
StreamingFunctionUtils
Utility class that contains helper methods to work with Flink Streaming
Functions . |
Modifier and Type | Class and Description |
---|---|
class |
KeySelectorUtil
Utility class that contains helper methods to manipulating
KeySelector for streaming. |
Modifier and Type | Class and Description |
---|---|
class |
FieldAccessor<T,F>
These classes encapsulate the logic of accessing a field specified by the user as either an index
or a field expression string.
|
class |
FieldAccessorFactory
Static factories for the
FieldAccessor utilities. |
Modifier and Type | Method and Description |
---|---|
static <T,F> FieldAccessor<T,F> |
FieldAccessorFactory.getAccessor(TypeInformation<T> typeInfo,
int pos,
ExecutionConfig config)
Creates a
FieldAccessor for the given field position, which can be used to get and
set the specified field on instances of this type. |
static <T,F> FieldAccessor<T,F> |
FieldAccessorFactory.getAccessor(TypeInformation<T> typeInfo,
String field,
ExecutionConfig config)
Creates a
FieldAccessor for the field that is given by a field expression, which can
be used to get and set the specified field on instances of this type. |
Modifier and Type | Class and Description |
---|---|
class |
AmbiguousTableFactoryException
Deprecated.
This exception is considered internal and has been erroneously placed in the *.api
package. It is replaced by
AmbiguousTableFactoryException and should not be used
directly anymore. |
class |
ExpressionParserException
Deprecated.
This exception is considered internal and has been erroneously placed in the *.api
package. It is replaced by
ExpressionParserException and should not be used directly
anymore. |
class |
NoMatchingTableFactoryException
Deprecated.
This exception is considered internal and has been erroneously placed in the *.api
package. It is replaced by
NoMatchingTableFactoryException and should not be used
directly anymore. |
Modifier and Type | Method and Description |
---|---|
ReadableConfig |
TableConfig.getRootConfiguration()
Gives direct access to the underlying environment-specific key-value map for advanced
configuration.
|
ClassLoader |
EnvironmentSettings.getUserClassLoader()
Returns the user
ClassLoader to use for code generation, UDF loading and other
operations requiring reflections on user code. |
void |
TableConfig.setRootConfiguration(ReadableConfig rootConfiguration)
Sets the given configuration as
TableConfig.rootConfiguration , which contains any configuration
set in the execution context. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamTableEnvironmentImpl
Abstract class to implement a
StreamTableEnvironment . |
Modifier and Type | Method and Description |
---|---|
StreamExecutionEnvironment |
AbstractStreamTableEnvironmentImpl.execEnv()
This is a temporary workaround for Python API.
|
Modifier and Type | Class and Description |
---|---|
class |
StreamStatementSetImpl
Implementation for
StreamStatementSet . |
class |
StreamTableEnvironmentImpl
The implementation for a Java
StreamTableEnvironment . |
Modifier and Type | Method and Description |
---|---|
InlineElement |
ExecutionConfigOptions.NotNullEnforcer.getDescription() |
InlineElement |
ExecutionConfigOptions.TypeLengthEnforcer.getDescription() |
InlineElement |
ExecutionConfigOptions.LegacyCastBehaviour.getDescription()
Deprecated.
|
InlineElement |
ExecutionConfigOptions.UidGeneration.getDescription() |
InlineElement |
TableConfigOptions.CatalogPlanCompilation.getDescription() |
InlineElement |
TableConfigOptions.CatalogPlanRestore.getDescription() |
Modifier and Type | Class and Description |
---|---|
class |
AnalyzeTableUtil
ANALYZE TABLE statement Util.
|
interface |
Registration
A way to register a table in a
TableEnvironment that this descriptor originates from. |
interface |
ResultProvider
An internal class which helps the client to get the execute result from a specific sink.
|
class |
StatementSetImpl<E extends TableEnvironmentInternal>
Implementation for
StatementSet . |
class |
StaticResultProvider
Create result provider from a static set of data using external types.
|
class |
TableEnvironmentImpl
Implementation of
TableEnvironment that works exclusively with Table API interfaces. |
interface |
TableEnvironmentInternal
An internal interface of
TableEnvironment that defines extended methods used for TableImpl . |
class |
TableImpl
Implementation for
Table . |
class |
TableResultImpl
Implementation for
TableResult . |
interface |
TableResultInternal
Internal interface with internal methods for
TableResult . |
Modifier and Type | Interface and Description |
---|---|
interface |
ExtendedRelTypeFactory
A factory for creating
RelDataType instances including Flink-specific extensions. |
Modifier and Type | Interface and Description |
---|---|
interface |
CatalogLock
An interface that allows source and sink to use global lock to some transaction-related things.
|
class |
CatalogManager
A manager for dealing with catalog objects such as tables, views, functions, and types.
|
class |
CatalogPropertiesUtil
Utilities for de/serializing
Catalog objects into a map of string properties. |
class |
CatalogTableImpl
Deprecated.
Use
CatalogTable.of(Schema, String, List, Map) or a custom implementation
instead. Don't implement against this internal class. It can lead to unintended side effects
if code checks against this class instead of the common interface. |
class |
CatalogViewImpl
Deprecated.
Use
CatalogView.of(Schema, String, String, String, Map) or a custom
implementation instead. Don't implement against this internal class. It can lead to
unintended side effects if code checks against this class instead of the common interface. |
class |
CommonCatalogOptions
A collection of
ConfigOption which are consistently used in multiple catalogs. |
class |
ConnectorCatalogTable<T1,T2>
|
class |
ContextResolvedFunction
This class contains information about a function and its relationship with a
Catalog , if
any. |
class |
ContextResolvedTable
This class contains information about a table, its
ResolvedSchema , its options and its
relationship with a Catalog , if any. |
class |
DefaultCatalogTable
Default implementation of a
CatalogTable . |
class |
ExternalCatalogTable
Helper
CatalogTable for representing a table that is backed by some inline connector
(i.e. |
class |
FunctionCatalog
Simple function catalog to store
FunctionDefinition s in catalogs. |
interface |
FunctionLookup
Catalog of functions that can resolve the name of a function to a
ContextResolvedFunction . |
class |
GenericInMemoryCatalogFactoryOptions
|
class |
ManagedTableListener
The listener for managed table operations.
|
class |
QueryOperationCatalogView
A view created from a
QueryOperation via operations on Table . |
class |
SchemaTranslator
|
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.hive.metastore.api.Table |
HiveCatalog.getHiveTable(ObjectPath tablePath) |
String |
HiveCatalog.getHiveVersion() |
static boolean |
HiveCatalog.isEmbeddedMetastore(HiveConf hiveConf) |
static boolean |
HiveCatalog.isHiveTable(Map<String,String> properties) |
static boolean |
HiveCatalog.isHiveTable(org.apache.hadoop.hive.metastore.api.Table table) |
void |
HiveCatalog.loadPartition(org.apache.hadoop.fs.Path loadPath,
ObjectPath tablePath,
Map<String,String> partSpec,
boolean isOverwrite,
boolean isSrcLocal) |
void |
HiveCatalog.loadTable(org.apache.hadoop.fs.Path loadPath,
ObjectPath tablePath,
boolean isOverwrite,
boolean isSrcLocal) |
Modifier and Type | Class and Description |
---|---|
class |
HiveMetastoreClientWrapper
Wrapper class for Hive Metastore Client, which embeds a HiveShim layer to handle different Hive
versions.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveCatalogFactoryOptions
ConfigOption s for HiveCatalog . |
Modifier and Type | Class and Description |
---|---|
class |
HiveTypeUtil
Utils to convert data types between Flink and Hive.
|
Modifier and Type | Class and Description |
---|---|
class |
ClientResourceManager
The
ClientResourceManager is able to remove the registered JAR resources with the
specified jar path. |
Modifier and Type | Class and Description |
---|---|
class |
ClientWrapperClassLoader
This class loader extends
FlinkUserCodeClassLoaders.SafetyNetWrapperClassLoader , upon the addURL method, it
also exposes a removeURL method which used to remove unnecessary jar from current
classloader path. |
Modifier and Type | Class and Description |
---|---|
class |
AddBoolBeforeReturnRewriter
A helper class of
FunctionSplitter . |
class |
BlockStatementGrouper
Groups end extract single line statements such as operations on fields/local variables, IF and
WHILE statements and extract new method for each group making them smaller.
|
class |
BlockStatementRewriter
Extract branch of IFs, ELSEs statements and WHILEs code blocks into smaller methods.
|
class |
BlockStatementSplitter
Extract statements from IFs, ELSEs and WHILEs blocks making them smaller.
|
class |
CodeSplitUtil
Utils for rewriters.
|
class |
DeclarationRewriter
Extract and rename local variables into member variables.
|
class |
FunctionSplitter
Split long functions into several smaller functions.
|
class |
JavaCodeSplitter
Rewrite generated java code so that the length of each method becomes smaller and can be
compiled.
|
class |
MemberFieldRewriter
Group member variables with the same type into arrays to reduce the number of members.
|
class |
ReturnValueRewriter
Rewrite functions with return values by splitting them into two functions and storing the return
values into member variables.
|
Modifier and Type | Interface and Description |
---|---|
interface |
RequireCatalogLock
Source and sink implement this interface if they require
CatalogLock . |
Modifier and Type | Class and Description |
---|---|
class |
UpdatableRowData
|
Modifier and Type | Class and Description |
---|---|
class |
BinaryArrayData
A binary implementation of
ArrayData which is backed by MemorySegment s. |
interface |
BinaryFormat
Binary format spanning
MemorySegment s. |
class |
BinaryMapData
[4 byte(keyArray size in bytes)] + [Key BinaryArray] + [Value BinaryArray].
|
class |
BinaryRawValueData<T>
A lazily binary implementation of
RawValueData which is backed by MemorySegment s
and generic Object . |
class |
BinaryRowData
An implementation of
RowData which is backed by MemorySegment instead of Object. |
class |
BinarySection
A basic implementation of
BinaryFormat which describe a section of memory. |
class |
BinarySegmentUtils
Utilities for binary data segments which heavily uses
MemorySegment . |
class |
BinaryStringData
|
class |
LazyBinaryFormat<T>
An abstract implementation fo
BinaryFormat which is lazily serialized into binary or
lazily deserialized into Java object. |
class |
NestedRowData
Its memory storage structure is exactly the same with
BinaryRowData . |
interface |
NullAwareGetters
Provides null related getters.
|
interface |
TypedSetters
Provide type specialized setters to reduce if/else and eliminate box and unbox.
|
Modifier and Type | Class and Description |
---|---|
class |
ColumnarArrayData
Columnar array to support access to vector column data.
|
class |
ColumnarMapData
Columnar map to support access to vector column data.
|
class |
ColumnarRowData
Columnar row to support access to vector column data.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ArrayColumnVector
Array column vector.
|
interface |
BooleanColumnVector
Boolean column vector.
|
interface |
ByteColumnVector
Byte column vector.
|
interface |
BytesColumnVector
Bytes column vector to get
BytesColumnVector.Bytes , it include original data and offset and length. |
interface |
ColumnVector
Nullable column vector.
|
interface |
DecimalColumnVector
Decimal column vector.
|
interface |
Dictionary
The interface for dictionary in AbstractColumnVector to decode dictionary encoded values.
|
interface |
DoubleColumnVector
Double column vector.
|
interface |
FloatColumnVector
Float column vector.
|
interface |
IntColumnVector
Int column vector.
|
interface |
LongColumnVector
Long column vector.
|
interface |
MapColumnVector
Map column vector.
|
interface |
RowColumnVector
Row column vector.
|
interface |
ShortColumnVector
Short column vector.
|
interface |
TimestampColumnVector
Timestamp column vector.
|
class |
VectorizedColumnBatch
A VectorizedColumnBatch is a set of rows, organized with each column as a vector.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractHeapVector
Heap vector that nullable shared structure.
|
class |
HeapArrayVector
This class represents a nullable heap array column vector.
|
class |
HeapBooleanVector
This class represents a nullable heap boolean column vector.
|
class |
HeapBytesVector
This class supports string and binary data by value reference -- i.e.
|
class |
HeapByteVector
This class represents a nullable byte column vector.
|
class |
HeapDoubleVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapFloatVector
This class represents a nullable double precision floating point column vector.
|
class |
HeapIntVector
This class represents a nullable int column vector.
|
class |
HeapLongVector
This class represents a nullable long column vector.
|
class |
HeapMapVector
This class represents a nullable heap map column vector.
|
class |
HeapRowVector
This class represents a nullable heap row column vector.
|
class |
HeapShortVector
This class represents a nullable short column vector.
|
class |
HeapTimestampVector
This class represents a nullable byte column vector.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractWritableVector
Contains the shared structure for
ColumnVector s, including NULL information and
dictionary. |
interface |
WritableBooleanVector
Writable
BooleanColumnVector . |
interface |
WritableBytesVector
Writable
BytesColumnVector . |
interface |
WritableByteVector
Writable
ByteColumnVector . |
interface |
WritableColumnVector
Writable
ColumnVector . |
interface |
WritableDoubleVector
Writable
DoubleColumnVector . |
interface |
WritableFloatVector
Writable
FloatColumnVector . |
interface |
WritableIntVector
Writable
IntColumnVector . |
interface |
WritableLongVector
Writable
LongColumnVector . |
interface |
WritableShortVector
Writable
ShortColumnVector . |
interface |
WritableTimestampVector
Writable
TimestampColumnVector . |
Modifier and Type | Class and Description |
---|---|
class |
ArrayBooleanArrayConverter
Converter for
ArrayType of boolean[] external type. |
class |
ArrayByteArrayConverter
Converter for
ArrayType of byte[] external type. |
class |
ArrayDoubleArrayConverter
Converter for
ArrayType of double[] external type. |
class |
ArrayFloatArrayConverter
Converter for
ArrayType of float[] external type. |
class |
ArrayIntArrayConverter
Converter for
ArrayType of int[] external type. |
class |
ArrayListConverter<E>
|
class |
ArrayLongArrayConverter
Converter for
ArrayType of long[] external type. |
class |
ArrayObjectArrayConverter<E>
Converter for
ArrayType of nested primitive or object arrays external types. |
class |
ArrayShortArrayConverter
Converter for
ArrayType of short[] external type. |
interface |
DataStructureConverter<I,E>
Converter between internal and external data structure.
|
class |
DataStructureConverters
Registry of available data structure converters.
|
class |
DateDateConverter
|
class |
DateLocalDateConverter
Converter for
DateType of LocalDate external type. |
class |
DayTimeIntervalDurationConverter
Converter for
DayTimeIntervalType of Duration external type. |
class |
DecimalBigDecimalConverter
Converter for
DecimalType of BigDecimal external type. |
class |
IdentityConverter<I>
No-op converter that just forwards its input.
|
class |
LocalZonedTimestampInstantConverter
Converter for
LocalZonedTimestampType of Instant external type. |
class |
LocalZonedTimestampIntConverter
Converter for
LocalZonedTimestampType of Integer external type. |
class |
LocalZonedTimestampLongConverter
Converter for
LocalZonedTimestampType of Long external type. |
class |
LocalZonedTimestampTimestampConverter
Converter for
LocalZonedTimestampType of Timestamp external type. |
class |
MapMapConverter<K,V>
|
class |
RawByteArrayConverter<T>
Converter for
RawType of byte[] external type. |
class |
RawObjectConverter<T>
Converter for
RawType of object external type. |
class |
RowRowConverter
|
class |
StringByteArrayConverter
|
class |
StringStringConverter
|
class |
StructuredObjectConverter<T>
Converter for
StructuredType of its implementation class. |
class |
TimeLocalTimeConverter
Converter for
TimeType of LocalTime external type. |
class |
TimeLongConverter
|
class |
TimestampLocalDateTimeConverter
Converter for
TimestampType of LocalDateTime external type. |
class |
TimestampTimestampConverter
Converter for
TimestampType of Timestamp external type. |
class |
TimeTimeConverter
|
class |
YearMonthIntervalPeriodConverter
Converter for
YearMonthIntervalType of Period external type. |
Modifier and Type | Interface and Description |
---|---|
interface |
CastExecutor<IN,OUT>
Interface to model a function that performs the casting of a value from one type to another.
|
Modifier and Type | Class and Description |
---|---|
class |
BinaryArrayWriter
Writer for binary array.
|
class |
BinaryRowWriter
Writer for
BinaryRowData . |
interface |
BinaryWriter
Writer to write a composite data format, like row, array.
|
Modifier and Type | Class and Description |
---|---|
class |
ListViewSerializer<T>
Deprecated.
|
class |
ListViewSerializerSnapshot<T>
Deprecated.
|
class |
ListViewTypeInfo<T>
Deprecated.
|
class |
ListViewTypeInfoFactory<T>
Deprecated.
|
class |
MapViewSerializer<K,V>
Deprecated.
|
class |
MapViewSerializerSnapshot<K,V>
Deprecated.
|
class |
MapViewTypeInfo<K,V>
Deprecated.
|
class |
MapViewTypeInfoFactory<K,V>
Deprecated.
|
class |
NullAwareMapSerializer<K,V>
Deprecated.
|
class |
NullAwareMapSerializerSnapshot<K,V>
Deprecated.
|
class |
NullSerializer
A serializer for null.
|
Modifier and Type | Interface and Description |
---|---|
interface |
Executor
It enables the execution of a graph of
Transformation s generated by the Planner . |
interface |
ExecutorFactory
Factory that creates an
Executor for submitting table programs. |
interface |
ExtendedOperationExecutor
An extended operation executor which provides method for executing operation.
|
interface |
InternalPlan
Internal interface wrapping a plan.
|
interface |
Parser
Provides methods for parsing SQL objects from a SQL string.
|
interface |
Planner
This interface serves two purposes:
SQL parser via
Planner.getParser() - transforms a SQL string into a Table API specific
objects e.g. |
interface |
PlannerFactory
Factory that creates
Planner . |
interface |
PlannerTypeInferenceUtil
Temporary utility for validation and output type inference until all
PlannerExpression
are upgraded to work with TypeInferenceUtil . |
interface |
StreamExecutorFactory
Sub interface of
ExecutorFactory to support DataStream API. |
Modifier and Type | Class and Description |
---|---|
class |
ConnectorDescriptorValidator
Deprecated.
|
class |
DescriptorProperties
Deprecated.
This utility will be dropped soon.
DynamicTableFactory is based on ConfigOption and catalogs use CatalogPropertiesUtil . |
interface |
DescriptorValidator
Deprecated.
See
Descriptor for details. |
class |
FileSystemValidator
Deprecated.
The legacy CSV connector has been replaced by
FileSource / FileSink .
It is kept only to support tests for the legacy connector stack. |
class |
OldCsvValidator
Deprecated.
Use the RFC-compliant
Csv format in the dedicated flink-formats/flink-csv
module instead. |
Modifier and Type | Class and Description |
---|---|
class |
ChainingOptimizingExecutor
Executor which will perform chaining optimization before generating the StreamGraph. |
Modifier and Type | Class and Description |
---|---|
class |
ApiExpressionUtils
Utilities for API-specific
Expression s. |
class |
ApiExpressionVisitor<R>
A visitor for all
Expression s that might be created during API translation. |
class |
ExpressionDefaultVisitor<T>
Implementation of
ExpressionVisitor that redirects all calls to ExpressionDefaultVisitor.defaultMethod(Expression) . |
class |
ExpressionParserException
Exception for all errors occurring during expression parsing.
|
class |
ExpressionUtils
Utility methods for working with
Expression s. |
class |
LocalReferenceExpression
Reference to entity local to a certain
QueryOperation . |
class |
ResolvedExpressionVisitor<R>
A visitor for all
ResolvedExpression s. |
Modifier and Type | Method and Description |
---|---|
static CallExpression |
CallExpression.permanent(BuiltInFunctionDefinition builtInFunctionDefinition,
List<ResolvedExpression> args,
DataType dataType)
Creates a
CallExpression to a resolved built-in function. |
Constructor and Description |
---|
CallExpression(boolean isTemporary,
FunctionIdentifier functionIdentifier,
FunctionDefinition functionDefinition,
List<ResolvedExpression> args,
DataType dataType) |
Modifier and Type | Class and Description |
---|---|
class |
ExpressionResolver
Tries to resolve all unresolved expressions such as
UnresolvedReferenceExpression or
calls such as BuiltInFunctionDefinitions.OVER . |
class |
LookupCallResolver
Resolves calls with function names to calls with actual function definitions.
|
interface |
SqlExpressionResolver
Translates a SQL expression string into a
ResolvedExpression . |
Modifier and Type | Class and Description |
---|---|
class |
FieldReferenceLookup
Provides a way to look up field reference by the name of the field.
|
interface |
TableReferenceLookup
Provides a way to look up table reference by the name of the table.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ResolverRule
Rule that can be applied during resolution of
Expression . |
class |
ResolverRules
Contains instances of
ResolverRule . |
Modifier and Type | Class and Description |
---|---|
class |
ApiExpressionDefaultVisitor<T>
A utility
ApiExpressionVisitor that calls ApiExpressionDefaultVisitor.defaultMethod(Expression) by default,
unless other methods are overridden explicitly. |
class |
ResolvedExpressionDefaultVisitor<T>
A utility
ResolvedExpressionVisitor that calls ResolvedExpressionDefaultVisitor.defaultMethod(ResolvedExpression)
by default, unless other methods are overridden explicitly. |
Modifier and Type | Class and Description |
---|---|
class |
AmbiguousTableFactoryException
Exception for finding more than one
TableFactory for the given properties. |
static class |
FactoryUtil.DefaultCatalogContext
Default implementation of
CatalogFactory.Context . |
static class |
FactoryUtil.DefaultDynamicTableContext
Default implementation of
DynamicTableFactory.Context . |
static class |
FactoryUtil.DefaultModuleContext
Default implementation of
ModuleFactory.Context . |
interface |
ManagedTableFactory
Base interface for configuring a managed dynamic table connector.
|
class |
NoMatchingTableFactoryException
Exception for not finding a
TableFactory for the given properties. |
class |
PlannerFactoryUtil
Utility for discovering and instantiating
PlannerFactory . |
class |
TableFactoryService
Deprecated.
|
class |
TableSinkFactoryContextImpl
Deprecated.
|
class |
TableSourceFactoryContextImpl
Deprecated.
|
Modifier and Type | Class and Description |
---|---|
class |
BuiltInFunctionDefinition
Definition of a built-in function.
|
class |
ScalarFunctionDefinition
Deprecated.
Non-legacy functions can simply omit this wrapper for declarations.
|
class |
TemporalTableFunctionImpl
Class representing temporal table function over some history table.
|
class |
UserDefinedFunctionHelper
Utility for dealing with subclasses of
UserDefinedFunction . |
Modifier and Type | Method and Description |
---|---|
static List<BuiltInFunctionDefinition> |
BuiltInFunctionDefinitions.getDefinitions() |
Modifier and Type | Class and Description |
---|---|
class |
DeferredObjectAdapter
Adapter from Java Object to Hive DeferredObject.
|
interface |
HiveFunction<UDFType>
Interface for Hive UDF, UDTF, UDAF.
|
class |
HiveFunctionWrapper<UDFType>
A wrapper of Hive functions that instantiate function instances and ser/de function instance
cross process boundary.
|
class |
HiveGenericUDAF
|
class |
HiveGenericUDF
A ScalarFunction implementation that calls Hive's
GenericUDF . |
class |
HiveGenericUDTF
A TableFunction implementation that calls Hive's
GenericUDTF . |
class |
HiveScalarFunction<UDFType>
Abstract class to provide more information for Hive
UDF and GenericUDF functions. |
class |
HiveSimpleUDF
A ScalarFunction implementation that calls Hive's
UDF . |
Modifier and Type | Class and Description |
---|---|
class |
HiveInspectors
Util for any ObjectInspector related inspection and conversion of Hive data to/from Flink data.
|
interface |
HiveObjectConversion
Interface to convert Flink object to Hive object.
|
class |
IdentityConversion
Conversion that return the same object.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveFunctionUtil
Util for Hive functions.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonAggregateFunction
The wrapper of user defined python aggregate function.
|
class |
PythonAggregateFunctionInfo
PythonAggregateFunctionInfo contains the execution information of a Python aggregate function,
such as: the actual Python aggregation function, the input arguments, the filter arg, the
distinct flag, etc.
|
class |
PythonEnv
Python execution environments.
|
interface |
PythonFunction
The base interface of a wrapper of a Python function.
|
class |
PythonFunctionInfo
PythonFunctionInfo contains the execution information of a Python function, such as: the actual
Python function, the input arguments, etc.
|
class |
PythonFunctionKind
Categorizes the Python functions.
|
class |
PythonScalarFunction
The wrapper of user defined python scalar function.
|
class |
PythonTableAggregateFunction
The wrapper of user defined python table aggregate function.
|
class |
PythonTableFunction
The wrapper of user defined python table function.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonFunctionUtils
Utilities for creating PythonFunction from the fully qualified name of a Python function.
|
Modifier and Type | Class and Description |
---|---|
static class |
SqlGatewayEndpointFactoryUtils.DefaultEndpointFactoryContext
The default context of
SqlGatewayEndpointFactory . |
Modifier and Type | Class and Description |
---|---|
class |
ThreadUtils
Utils for thread pool executor.
|
Modifier and Type | Class and Description |
---|---|
class |
ColumnInfo
A column info represents a table column's structure with column name, column type.
|
class |
JsonResultSetDeserializer
Json deserializer for
ResultSet . |
class |
JsonResultSetSerializer
Json serializer for
ResultSet . |
class |
LogicalTypeJsonDeserializer
JSON deserializer for
LogicalType . |
class |
LogicalTypeJsonSerializer
Json serializer for
LogicalType . |
class |
RowDataInfo
A RowDataInfo info represents a
RowData . |
Modifier and Type | Class and Description |
---|---|
class |
OperationManager
Manager for the
OperationManager.Operation . |
Modifier and Type | Class and Description |
---|---|
class |
CommonModuleOptions
A collection of
ConfigOption which are consistently used in multiple modules. |
class |
CoreModuleFactory
Factory for
CoreModule . |
class |
ModuleManager
Responsible for loading/unloading modules, managing their life cycles, and resolving module
objects.
|
Modifier and Type | Class and Description |
---|---|
class |
HiveModuleFactory
Factory for
HiveModule . |
Modifier and Type | Class and Description |
---|---|
class |
AggregateQueryOperation
Relational operation that performs computations on top of subsets of input rows grouped by key.
|
class |
BeginStatementSetOperation
Operation to describe a BEGIN STATEMENT SET statement.
|
class |
CalculatedQueryOperation
Describes a relational operation that was created from applying a
TableFunction . |
class |
CollectModifyOperation
Special, internal kind of
ModifyOperation that collects the content of QueryOperation to local. |
class |
CompileAndExecutePlanOperation
Operation to describe an
COMPILE AND EXECUTE PLAN statement. |
class |
CreateTableASOperation
Operation to describe a CREATE TABLE AS statement.
|
class |
DataStreamQueryOperation<E>
Deprecated.
|
class |
DistinctQueryOperation
Removes duplicated rows of underlying relational operation.
|
class |
EndStatementSetOperation
Operation to describe a End statement.
|
class |
ExplainOperation
Operation to describe an EXPLAIN statement.
|
class |
ExternalModifyOperation
Internal operation used to convert a
Table into a DataStream. |
class |
ExternalQueryOperation<E>
Describes a relational operation that reads from a
DataStream . |
class |
FilterQueryOperation
Filters out rows of underlying relational operation that do not match given condition.
|
class |
JoinQueryOperation
Table operation that joins two relational operations based on given condition.
|
class |
LoadModuleOperation
Operation to describe a LOAD MODULE statement.
|
interface |
ModifyOperation
A
Operation that describes the DML queries such as e.g. |
interface |
ModifyOperationVisitor<T>
Class that implements visitor pattern.
|
class |
OperationUtils
Helper methods for
Operation s. |
class |
OutputConversionModifyOperation
Special, internal kind of
ModifyOperation that allows converting a tree of QueryOperation s to a Transformation of given type described with TypeInformation . |
class |
ProjectQueryOperation
Table operation that computes new table using given
Expression s from its input relational
operation. |
interface |
QueryOperationVisitor<T>
Class that implements visitor pattern.
|
class |
SetQueryOperation
A set operation on two relations.
|
interface |
ShowOperation
An
Operation that show one kind of objects, e.g. |
class |
SinkModifyOperation
DML operation that tells to write to a sink.
|
class |
SortQueryOperation
Expresses sort operation of rows of the underlying relational operation with given order.
|
class |
SourceQueryOperation
Describes a query operation from a
ContextResolvedTable . |
class |
StatementSetOperation
A
Operation that describes the statement set, e.g. |
class |
TableSourceQueryOperation<T>
Inline scan of a
TableSource . |
class |
UnregisteredSinkModifyOperation<T>
DML operation that tells to write to the given sink.
|
interface |
UseOperation
An
Operation that describes the catalog/database switch statements, e.g. |
class |
ValuesQueryOperation
Table operation that computes new table using given
Expression s from its input relational
operation. |
class |
WindowAggregateQueryOperation
Relational operation that performs computations on top of subsets of input rows grouped by key
and group window.
|
static class |
WindowAggregateQueryOperation.ResolvedGroupWindow
Wrapper for resolved expressions of a
GroupWindow . |
Modifier and Type | Class and Description |
---|---|
class |
ExecutePlanOperation
Operation to describe an EXECUTE PLAN statement.
|
Modifier and Type | Interface and Description |
---|---|
interface |
AlterOperation
A
Operation that describes the DDL statements, e.g. |
interface |
CreateOperation
A
Operation that describes the DDL statements, e.g. |
Modifier and Type | Class and Description |
---|---|
class |
OperationExpressionsUtils
Utility methods for transforming
Expression to use them in QueryOperation s. |
class |
OperationTreeBuilder
A builder for constructing validated
QueryOperation s. |
class |
QueryOperationDefaultVisitor<T>
A utility
QueryOperationVisitor that calls QueryOperationDefaultVisitor.defaultMethod(QueryOperation) by default, unless other methods are
overridden explicitly. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkCalciteSqlValidator
Extends Calcite's
SqlValidator by Flink-specific behavior. |
class |
FlinkConvertletTable
Custom Flink
SqlRexConvertletTable to add custom SqlNode to RexNode
conversions. |
class |
FlinkRelBuilder
Flink-specific
RelBuilder . |
class |
FlinkTypeSystem
Custom type system for Flink.
|
class |
RexFactory
Planner internal factory for parsing/translating to
RexNode . |
class |
SqlToRexConverter
Converts SQL expressions to
RexNode . |
Modifier and Type | Class and Description |
---|---|
class |
CatalogCalciteSchema
A mapping between Flink's catalog and Calcite's schema.
|
class |
CatalogManagerCalciteSchema
Bridge between the
CatalogManager and the Schema . |
class |
FunctionCatalogOperatorTable
Thin adapter between
SqlOperatorTable and FunctionCatalog . |
Modifier and Type | Class and Description |
---|---|
class |
CollectDynamicSink
Table sink for
TableResult.collect() . |
class |
DynamicSinkUtils
Utilities for dealing with
DynamicTableSink . |
class |
DynamicSourceUtils
Utilities for dealing with
DynamicTableSource . |
interface |
TransformationScanProvider
Provider that produces a
Transformation as a runtime implementation for ScanTableSource . |
interface |
TransformationSinkProvider
Provider that produces a
Transformation as a runtime implementation for DynamicTableSink . |
Modifier and Type | Class and Description |
---|---|
class |
DefaultExecutor
Default implementation of
Executor . |
class |
DefaultExecutorFactory
Factory to create the default implementation of an
Executor for TableEnvironment . |
class |
DefaultPlannerFactory
Factory for the default
Planner . |
interface |
DialectFactory
Factory that creates
Parser and ExtendedOperationExecutor . |
class |
PlannerContext
Utility class to create
RelBuilder or FrameworkConfig
used to create a corresponding Planner . |
Modifier and Type | Class and Description |
---|---|
class |
PlannerTypeInferenceUtilImpl
Implementation of
PlannerTypeInferenceUtil . |
class |
RexNodeExpression
Wrapper for a
ResolvedExpression that originated from a RexNode . |
class |
UnresolvedException
Exception for unwanted method calling on unresolved expression.
|
Modifier and Type | Method and Description |
---|---|
static UnresolvedCallExpression |
ExpressionBuilder.aggDecimalMinus(Expression input1,
Expression input2)
Used only for implementing SUM/AVG aggregations (with and without retractions) on a Decimal
type to avoid overriding decimal precision/scale calculation for sum/avg with the rules
applied for the normal minus.
|
static UnresolvedCallExpression |
ExpressionBuilder.aggDecimalPlus(Expression input1,
Expression input2)
Used only for implementing SUM/AVG aggregations (with and without retractions) on a Decimal
type to avoid overriding decimal precision/scale calculation for sum/avg with the rules
applied for the normal plus.
|
Modifier and Type | Interface and Description |
---|---|
interface |
CallExpressionConvertRule
Rule to convert
CallExpression . |
class |
CustomizedConvertRule
Customized
CallExpressionConvertRule , Functions conversion here all require special
logic, and there may be some special rules, such as needing get the literal values of inputs,
such as converting to combinations of functions, to convert to RexNode of calcite. |
class |
DirectConvertRule
A
CallExpressionConvertRule that performs a simple one-to-one mapping between FunctionDefinition and a corresponding SqlOperator . |
Modifier and Type | Class and Description |
---|---|
class |
CustomizedConverter
Customized converter used by
CustomizedConvertRule . |
class |
CustomizedConverters
Registry of customized converters used by
CustomizedConvertRule . |
Modifier and Type | Class and Description |
---|---|
class |
BridgingSqlAggFunction
Bridges
FunctionDefinition to Calcite's representation of an aggregating function (either
a system or user-defined function). |
class |
BridgingSqlFunction
Bridges
FunctionDefinition to Calcite's representation of a scalar or table function
(either a system or user-defined function). |
Modifier and Type | Class and Description |
---|---|
class |
CastCodeBlock
Generated cast code block result.
|
interface |
CastRule<IN,OUT>
A
CastRule provides the logic to create a CastExecutor starting from the input
and the target types. |
class |
CastRulePredicate
In order to apply a
CastRule , the runtime checks if a particular rule matches the tuple
of input and target type using this class. |
class |
CastRuleProvider
This class resolves
CastRule using the input and the target type. |
interface |
CodeGeneratorCastRule<IN,OUT>
Cast rule that has code generation capabilities.
|
interface |
ExpressionCodeGeneratorCastRule<IN,OUT>
Cast rule that is able to generate a single expression containing all the casting logic.
|
class |
RowDataToStringConverterImpl
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractSqlCallContext
A
CallContext backed by Calcite abstractions. |
class |
ArgumentCountRange
A
SqlOperandCountRange backed by ArgumentCount . |
class |
CallBindingCallContext
A
CallContext backed by SqlCallBinding . |
class |
LookupCallContext
The
CallContext of a LookupTableSource runtime function. |
class |
OperatorBindingCallContext
A
CallContext backed by SqlOperatorBinding . |
class |
TypeInferenceOperandChecker
A
SqlOperandTypeChecker backed by TypeInference . |
class |
TypeInferenceOperandInference
A
SqlOperandTypeInference backed by TypeInference . |
class |
TypeInferenceReturnInference
A
SqlReturnTypeInference backed by TypeInference . |
Modifier and Type | Class and Description |
---|---|
class |
BuiltInSqlFunction
SQL version of
BuiltInFunctionDefinition in cases where BridgingSqlFunction does
not apply. |
interface |
BuiltInSqlOperator
SQL version of
BuiltInFunctionDefinition in cases where BridgingSqlFunction does
not apply. |
class |
FlinkSqlTimestampFunction
Function that used to define SQL time function like LOCALTIMESTAMP, CURRENT_TIMESTAMP,
CURRENT_ROW_TIMESTAMP(), NOW() in Flink, the function support configuring the return type and the
precision of return type.
|
class |
SqlTryCastFunction
This class implements the
TRY_CAST built-in, essentially delegating all the method
invocations, whenever is possible, to Calcite's SqlCastFunction . |
Modifier and Type | Class and Description |
---|---|
class |
SqlAuxiliaryGroupAggFunction
An internal [[SqlAggFunction]] to represents auxiliary group keys which will not be computed as
key and does not also affect the correctness of the final result.
|
Modifier and Type | Class and Description |
---|---|
class |
LookupJoinHintOptions
This
LookupJoinHintOptions defines valid hint options of lookup join hint. |
Modifier and Type | Class and Description |
---|---|
class |
DelegateExecutorFactory
Delegate of
ExecutorFactory . |
class |
DelegatePlannerFactory
Delegate of
PlannerFactory . |
Modifier and Type | Class and Description |
---|---|
class |
InternalDataStreamQueryOperation<E>
Deprecated.
|
class |
PlannerQueryOperation
Wrapper for valid logical plans generated by Planner.
|
class |
RichTableSourceQueryOperation<T>
A
TableSourceQueryOperation with FlinkStatistic and qualifiedName. |
Modifier and Type | Class and Description |
---|---|
class |
ExecNodeGraphInternalPlan
Implementation of
CompiledPlan backed by an ExecNodeGraph . |
class |
QueryOperationConverter
Converter from Flink's specific relational representation:
QueryOperation to Calcite's
specific relational representation: RelNode . |
Modifier and Type | Interface and Description |
---|---|
interface |
SinkAbilitySpec
An interface that can not only serialize/deserialize the sink abilities to/from JSON, but also
can apply the abilities to a
DynamicTableSink . |
Modifier and Type | Interface and Description |
---|---|
interface |
SourceAbilitySpec
An interface that can not only serialize/deserialize the source abilities to/from JSON, but also
can apply the abilities to a
DynamicTableSource . |
Modifier and Type | Interface and Description |
---|---|
interface |
ExecNode<T>
The representation of execution information for a
FlinkPhysicalRel . |
class |
ExecNodeConfig
Configuration view which is used combine the
PlannerBase.getTableConfig() with the ExecNodeBase.getPersistedConfig() configuration. |
class |
ExecNodeContext
Helper class that holds the necessary identifier fields that are used for JSON plan serialization
and deserialization.
|
interface |
ExecNodeMetadata
Annotation to be used for
ExecNode s to keep necessary metadata when
serializing/deserializing them in a plan. |
interface |
ExecNodeTranslator<T>
|
class |
InputProperty
The
InputProperty describes the input information of the ExecNode . |
interface |
MultipleExecNodeMetadata
Helper annotation to enable multiple
ExecNodeMetadata annotations on an ExecNode
class. |
interface |
MultipleTransformationTranslator<T>
An
ExecNodeTranslator that will generate ZERO, ONE or more Transformation s. |
interface |
SingleTransformationTranslator<T>
An
ExecNodeTranslator that will generate only ONE Transformation . |
Modifier and Type | Interface and Description |
---|---|
interface |
BatchExecNode<T>
Base class for batch
ExecNode . |
interface |
InputSortedExecNode<T>
A
BatchExecNode which does not sort the input data within the operator, but requires the
input data is already sorted. |
Modifier and Type | Class and Description |
---|---|
class |
InputOrderCalculator
Subclass of the
InputPriorityGraphGenerator . |
class |
InputPriorityConflictResolver
Subclass of the
InputPriorityGraphGenerator . |
class |
InputPriorityGraphGenerator
This class contains algorithm to detect and resolve input priority conflict in an
ExecNode graph. |
Modifier and Type | Class and Description |
---|---|
class |
ConfigurationJsonSerializerFilter
Custom filtering for
Configuration used by ExecNodeBase.getPersistedConfig() to
avoid serializing null or empty configurations. |
class |
JsonSerdeUtil
A utility class that provide abilities for JSON serialization and deserialization.
|
class |
SerdeContext
A context to allow the store user-defined data within ExecNode serialization and deserialization.
|
Modifier and Type | Interface and Description |
---|---|
interface |
StreamExecNode<T>
Base class for stream
ExecNode . |
Modifier and Type | Class and Description |
---|---|
class |
PushProjectIntoTableSourceScanRule
Pushes a
LogicalProject into a LogicalTableScan . |
class |
RemoveUnreachableCoalesceArgumentsRule
Removes unreachable
BuiltInFunctionDefinitions.COALESCE arguments. |
class |
WrapJsonAggFunctionArgumentsRule
Transforms JSON aggregation functions by wrapping operands into
BuiltInFunctionDefinitions.JSON_STRING . |
Modifier and Type | Class and Description |
---|---|
class |
PushFilterPastChangelogNormalizeRule
Pushes primary key filters through a
ChangelogNormalize
operator to reduce its state size. |
Modifier and Type | Class and Description |
---|---|
class |
FlinkPreparingTableBase
A Flink
Prepare.AbstractPreparingTable implementation for the
purposes of the sql-to-rel conversion and planner. |
class |
RawRelDataType
The
RelDataType representation of a RawType . |
class |
StructuredRelDataType
The
RelDataType representation of a StructuredType . |
Modifier and Type | Class and Description |
---|---|
class |
ExecNodeMetadataUtil
Utility class for
ExecNodeMetadata related functionality. |
class |
LookupJoinUtil
Utilities for lookup joins using
LookupTableSource . |
class |
RexLiteralUtil
Utilities to work with
RexLiteral . |
class |
WindowTableFunctionUtil
Utilities for Window Table Function.
|
Modifier and Type | Class and Description |
---|---|
class |
DataViewUtils
Utilities to deal with
DataView s. |
class |
LogicalRelDataTypeConverter
Symmetric converter between
LogicalType and RelDataType . |
class |
SymbolUtil
Utilities to map between symbols from both Calcite and Flink.
|
Modifier and Type | Class and Description |
---|---|
class |
InternalConfigOptions
This class holds internal configuration constants used by Flink's table module.
|
class |
ShortcutUtils
Utilities for quick access of commonly used instances (like
FlinkTypeFactory ) without
long chains of getters or casting like (FlinkTypeFactory)
agg.getCluster.getTypeFactory() . |
class |
StreamExchangeModeUtils
Utility class to load job-wide exchange mode.
|
class |
TimestampStringUtils
Utility functions for calcite's
TimestampString . |
Modifier and Type | Class and Description |
---|---|
class |
ResourceManager
A manager for dealing with all user defined resource.
|
Modifier and Type | Class and Description |
---|---|
class |
ArrowReader
ArrowReader which read the underlying Arrow format data as RowData . |
class |
ArrowUtils
Utilities for Arrow.
|
class |
ArrowWriter<IN>
Writer which serializes the Flink rows to Arrow format.
|
Modifier and Type | Class and Description |
---|---|
class |
ArrowSerializer
The base class ArrowSerializer which will serialize/deserialize RowType data to/from arrow bytes.
|
Modifier and Type | Class and Description |
---|---|
class |
ArrowSourceFunction
An Arrow
SourceFunction which takes the serialized arrow record batch data as input. |
class |
ArrowTableSource
A
StreamTableSource for serialized arrow record batch data. |
Modifier and Type | Class and Description |
---|---|
class |
ArrowArrayColumnVector
Arrow column vector for Array.
|
class |
ArrowBigIntColumnVector
Arrow column vector for BigInt.
|
class |
ArrowBooleanColumnVector
Arrow column vector for Boolean.
|
class |
ArrowDateColumnVector
Arrow column vector for Date.
|
class |
ArrowDecimalColumnVector
Arrow column vector for DecimalData.
|
class |
ArrowDoubleColumnVector
Arrow column vector for Double.
|
class |
ArrowFloatColumnVector
Arrow column vector for Float.
|
class |
ArrowIntColumnVector
Arrow column vector for Int.
|
class |
ArrowRowColumnVector
Arrow column vector for Row.
|
class |
ArrowSmallIntColumnVector
Arrow column vector for Int.
|
class |
ArrowTimeColumnVector
Arrow column vector for Time.
|
class |
ArrowTimestampColumnVector
Arrow column vector for Timestamp.
|
class |
ArrowTinyIntColumnVector
Arrow column vector for TinyInt.
|
class |
ArrowVarBinaryColumnVector
Arrow column vector for VarBinary.
|
class |
ArrowVarCharColumnVector
Arrow column vector for VarChar.
|
Modifier and Type | Class and Description |
---|---|
class |
ArrayWriter<T>
ArrowFieldWriter for Array. |
class |
ArrowFieldWriter<IN>
Base class for arrow field writer which is used to convert a field to an Arrow format.
|
class |
BigIntWriter<T>
ArrowFieldWriter for BigInt. |
class |
BooleanWriter<T>
ArrowFieldWriter for Boolean. |
class |
DateWriter<T>
ArrowFieldWriter for Date. |
class |
DecimalWriter<T>
ArrowFieldWriter for Decimal. |
class |
DoubleWriter<T>
ArrowFieldWriter for Double. |
class |
FloatWriter<T>
ArrowFieldWriter for Float. |
class |
IntWriter<T>
ArrowFieldWriter for Int. |
class |
RowWriter<T>
ArrowFieldWriter for Row. |
class |
SmallIntWriter<T>
ArrowFieldWriter for SmallInt. |
class |
TimestampWriter<T>
ArrowFieldWriter for Timestamp. |
class |
TimeWriter<T>
ArrowFieldWriter for Time. |
class |
TinyIntWriter<T>
ArrowFieldWriter for TinyInt. |
class |
VarBinaryWriter<T>
ArrowFieldWriter for VarBinary. |
class |
VarCharWriter<T>
ArrowFieldWriter for VarChar. |
Modifier and Type | Class and Description |
---|---|
class |
ListenableCollector<T>
A listenable collector for lookup join that can be called when an original record was collected.
|
Modifier and Type | Class and Description |
---|---|
class |
SinkRuntimeProviderContext
Implementation of
DynamicTableSink.Context . |
Modifier and Type | Class and Description |
---|---|
class |
LookupRuntimeProviderContext
Implementation of
LookupTableSource.Context . |
class |
ScanRuntimeProviderContext
Implementation of
ScanTableSource.Context . |
Modifier and Type | Class and Description |
---|---|
class |
DataViewSpec
Information about a
DataView stored in state. |
class |
ListViewSpec
Specification for a
ListView . |
class |
MapViewSpec
Specification for a
MapView . |
class |
PerKeyStateDataViewStore
Default implementation of
StateDataViewStore that currently forwards state registration
to a RuntimeContext . |
class |
PerWindowStateDataViewStore
An implementation of
StateDataViewStore for window aggregates which forwards the state
registration to an underlying KeyedStateBackend . |
interface |
StateDataView<N>
A
DataView which is implemented using state backend. |
interface |
StateDataViewStore
This interface contains methods for registering
StateDataView with a managed store. |
class |
StateListView<N,EE>
StateListView is a ListView which is implemented using state backends. |
class |
StateMapView<N,EK,EV>
MapView which is implemented using state backends. |
Modifier and Type | Class and Description |
---|---|
class |
BuiltInSpecializedFunction
Base class for built-in functions that need another level of specialization via
SpecializedFunction.specialize(SpecializedContext) . |
class |
DefaultExpressionEvaluator
Default runtime implementation for
SpecializedFunction.ExpressionEvaluator . |
class |
SqlJsonUtils
Utilities for JSON functions.
|
Modifier and Type | Class and Description |
---|---|
class |
BuiltInAggregateFunction<T,ACC>
Base class for runtime implementation represented as
AggregateFunction that is
constructed from SpecializedFunction.specialize(SpecializedContext) . |
class |
CollectAggFunction<T>
Built-in COLLECT aggregate function.
|
class |
FirstValueAggFunction<T>
Built-in FIRST_VALUE aggregate function.
|
class |
FirstValueWithRetractAggFunction<T>
Built-in FIRST_VALUE with retraction aggregate function.
|
class |
JsonArrayAggFunction
|
class |
JsonObjectAggFunction
|
class |
LastValueAggFunction<T>
Built-in LAST_VALUE aggregate function.
|
class |
LastValueWithRetractAggFunction<T>
Built-in LAST_VALUE with retraction aggregate function.
|
class |
ListAggWithRetractAggFunction
Built-in LISTAGG with retraction aggregate function.
|
class |
ListAggWsWithRetractAggFunction
Built-in LISTAGGWS with retraction aggregate function.
|
class |
MaxWithRetractAggFunction<T extends Comparable<T>>
Built-in MAX with retraction aggregate function.
|
class |
MinWithRetractAggFunction<T extends Comparable<T>>
Built-in MIN with retraction aggregate function.
|
Modifier and Type | Class and Description |
---|---|
class |
ArrayContainsFunction
Implementation of
BuiltInFunctionDefinitions.ARRAY_CONTAINS . |
class |
BuiltInScalarFunction
Base class for runtime implementation represented as
ScalarFunction that is constructed
from SpecializedFunction.specialize(SpecializedContext) . |
class |
CoalesceFunction
Implementation of
BuiltInFunctionDefinitions.COALESCE . |
class |
IfNullFunction
Implementation of
BuiltInFunctionDefinitions.IF_NULL . |
class |
SourceWatermarkFunction
Implementation of
BuiltInFunctionDefinitions.SOURCE_WATERMARK . |
class |
TypeOfFunction
Implementation of
BuiltInFunctionDefinitions.TYPE_OF . |
Modifier and Type | Class and Description |
---|---|
class |
BuiltInTableFunction<T>
Base class for runtime implementation represented as
TableFunction that is constructed
from SpecializedFunction.specialize(SpecializedContext) . |
class |
ReplicateRowsFunction
Replicate the row N times.
|
class |
UnnestRowsFunction
Flattens ARRAY, MAP, and MULTISET using a table function.
|
Modifier and Type | Class and Description |
---|---|
class |
CachingLookupFunction
A wrapper function around user-provided lookup function with a cache layer.
|
class |
LookupCacheManager
Managing shared caches across different subtasks.
|
Modifier and Type | Class and Description |
---|---|
class |
LookupFullCache
Internal implementation of
LookupCache for LookupOptions.LookupCacheType.FULL . |
Modifier and Type | Class and Description |
---|---|
class |
GeneratedWatermarkGeneratorSupplier
Wrapper of the
GeneratedWatermarkGenerator that is used to create WatermarkGenerator . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractWindowProperty
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
NamedWindowProperty
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
ProctimeAttribute
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
RowtimeAttribute
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
SliceEnd
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
WindowEnd
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
interface |
WindowProperty
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
class |
WindowReference
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they are also used to configure Python operators.
|
class |
WindowStart
Deprecated.
The POJOs in this package are used to represent the deprecated Group Window feature.
Currently, they also used to configure Python operators.
|
Modifier and Type | Interface and Description |
---|---|
interface |
WindowBuffer
A buffer that buffers data in memory and flushes many values to state together at a time to avoid
frequently accessing state, or flushes to output to reduce shuffling data.
|
Modifier and Type | Interface and Description |
---|---|
interface |
BundleTrigger<T>
A
BundleTrigger determines when a bundle of input elements should be evaluated and
trigger the callback which registered previously. |
interface |
BundleTriggerCallback
Interface for bundle trigger callbacks that can be registered to a
BundleTrigger . |
interface |
CoBundleTrigger<IN1,IN2>
A
CoBundleTrigger is similar with BundleTrigger , and the only differences is
CoBundleTrigger can handle two inputs. |
Modifier and Type | Class and Description |
---|---|
class |
FilterAllFlatMapFunction
Function filtering out all the input records.
|
class |
PaddingLeftMapFunction
Function performing left padding.
|
class |
PaddingRightMapFunction
Function performing right padding.
|
Modifier and Type | Class and Description |
---|---|
class |
BaseTwoInputStreamOperatorWithStateRetention
An abstract
TwoInputStreamOperator that allows its subclasses to clean up their state
based on a TTL. |
Modifier and Type | Class and Description |
---|---|
class |
ExceptionInMultipleInputOperatorException
A special exception that signifies that the cause exception came from a
MultipleInputStreamOperatorBase . |
Modifier and Type | Class and Description |
---|---|
class |
AbstractEmbeddedStatelessFunctionOperator
Base class for all stream operators to execute Python Stateless Functions in embedded Python
environment.
|
class |
AbstractOneInputPythonFunctionOperator<IN,OUT>
Base class for all one input stream operators to execute Python functions.
|
class |
AbstractStatelessFunctionOperator<IN,OUT,UDFIN>
Base class for all stream operators to execute Python Stateless Functions.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonStreamAggregateOperator
Base class for
AbstractPythonStreamGroupAggregateOperator and PythonStreamGroupWindowAggregateOperator . |
class |
AbstractPythonStreamGroupAggregateOperator
Base class for
PythonStreamGroupAggregateOperator and PythonStreamGroupTableAggregateOperator . |
class |
PythonStreamGroupAggregateOperator
The Python AggregateFunction operator.
|
class |
PythonStreamGroupTableAggregateOperator
The Python TableAggregateFunction operator.
|
class |
PythonStreamGroupWindowAggregateOperator<K,W extends Window>
The Python Group Window AggregateFunction operator.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractArrowPythonAggregateFunctionOperator
The Abstract class of Arrow Aggregate Operator for Pandas
AggregateFunction . |
Modifier and Type | Class and Description |
---|---|
class |
BatchArrowPythonGroupAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Aggregation. |
class |
BatchArrowPythonGroupWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
BatchArrowPythonOverWindowAggregateFunctionOperator
The Batch Arrow Python
AggregateFunction Operator for Over Window Aggregation. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractStreamArrowPythonBoundedRangeOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for RANGE clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonBoundedRowsOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for ROWS clause
bounded Over Window Aggregation. |
class |
AbstractStreamArrowPythonOverWindowAggregateFunctionOperator<K>
The Abstract class of Stream Arrow Python
AggregateFunction Operator for Over Window
Aggregation. |
class |
StreamArrowPythonGroupWindowAggregateFunctionOperator<K,W extends Window>
The Stream Arrow Python
AggregateFunction Operator for Group Window Aggregation. |
class |
StreamArrowPythonProcTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonProcTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for ROWS clause proc-time bounded OVER
window. |
class |
StreamArrowPythonRowTimeBoundedRangeOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
class |
StreamArrowPythonRowTimeBoundedRowsOperator<K>
The Stream Arrow Python
AggregateFunction Operator for RANGE clause event-time bounded
OVER window. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractPythonScalarFunctionOperator
Base class for all stream operators to execute Python
ScalarFunction s. |
class |
EmbeddedPythonScalarFunctionOperator
The Python
ScalarFunction operator in embedded Python environment. |
class |
PythonScalarFunctionOperator
The Python
ScalarFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
ArrowPythonScalarFunctionOperator
Arrow Python
ScalarFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
EmbeddedPythonTableFunctionOperator
The Python
TableFunction operator in embedded Python environment. |
class |
PythonTableFunctionOperator
The Python
TableFunction operator. |
Modifier and Type | Class and Description |
---|---|
class |
ConstraintEnforcer
Processes
RowData to enforce the following constraints:
NOT NULL column constraint of a sink table
CHAR(length) /@{code VARCHAR(length)}: trim string values to comply with the length defined in their corresponding types. |
static class |
ConstraintEnforcer.FieldInfo
Helper POJO to keep info about CHAR/VARCHAR/BINARY/VARBINARY fields, used to determine if
trimming or padding is needed.
|
class |
OutputConversionOperator
Operator that converts to external data structures and unwraps atomic records if necessary.
|
class |
StreamRecordTimestampInserter
Operator which sets the timestamp on the StreamRecord from the corresponding column of each row.
|
Modifier and Type | Class and Description |
---|---|
class |
InputConversionOperator<E>
Operator that converts to internal data structures and wraps atomic records if necessary.
|
Modifier and Type | Interface and Description |
---|---|
interface |
RecordsCombiner
The
RecordsCombiner is used to combine buffered records into state. |
Modifier and Type | Interface and Description |
---|---|
interface |
ClockService
A clock service which can get current processing time.
|
interface |
SliceAssigner
A
SliceAssigner assigns element into a single slice. |
class |
SliceAssigners
Utilities to create
SliceAssigner s. |
interface |
SliceSharedAssigner
A
SliceAssigner which shares slices for windows, which means a window is divided into
multiple slices and need to merge the slices into windows when emitting windows. |
interface |
SliceUnsharedAssigner
A
SliceAssigner which doesn't share slices for windows, which means a window is divided
into only one slice and doesn't need to merge the slices when emitting windows. |
class |
SlicingWindowOperator<K,W>
The
SlicingWindowOperator implements an optimized processing for aligned windows which
can apply the slicing optimization. |
interface |
SlicingWindowProcessor<W>
A processor that processes elements for slicing windows.
|
interface |
WindowTimerService<W>
Interface for working with window time and timers which considers timezone for window splitting.
|
Modifier and Type | Class and Description |
---|---|
class |
WindowTrigger<W extends Window>
A
WindowTrigger determines when a window should be evaluated to emit the results. |
Modifier and Type | Class and Description |
---|---|
class |
PeriodicWatermarkAssignerWrapper
Generates periodic watermarks based on a
PeriodicWatermarkAssigner . |
class |
PunctuatedWatermarkAssignerWrapper
Generates periodic watermarks based on a
PunctuatedWatermarkAssigner . |
Modifier and Type | Class and Description |
---|---|
class |
BeamTablePythonFunctionRunner
A
BeamTablePythonFunctionRunner used to execute Python functions in Table API. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractRowDataSerializer<T extends RowData>
Row serializer, provided paged serialize paged method.
|
class |
ArrayDataSerializer
Serializer for
ArrayData . |
class |
BinaryRowDataSerializer
Serializer for
BinaryRowData . |
class |
DecimalDataSerializer
Serializer for
DecimalData . |
class |
DecimalDataTypeInfo
TypeInformation for
DecimalData . |
class |
ExternalSerializer<I,E>
A serializer that can serialize and deserialize all data structures defined by a
DataType . |
class |
ExternalTypeInfo<T>
Type information that wraps a serializer that originated from a
DataType . |
class |
InternalSerializers
TypeSerializer of LogicalType for internal data structures. |
class |
InternalTypeInfo<T>
Type information that wraps a serializer that originated from a
LogicalType . |
class |
LinkedListSerializer<T>
A serializer for
LinkedList . |
class |
MapDataSerializer
Serializer for
MapData . |
class |
PagedTypeSerializer<T>
A type serializer which provides paged serialize and deserialize methods.
|
class |
PythonTypeUtils
Utilities for converting Flink logical types, such as convert it to the related TypeSerializer or
ProtoType.
|
class |
RawValueDataSerializer<T>
Serializer for
RawValueData . |
class |
RowDataSerializer
Serializer for
RowData . |
class |
StringDataSerializer
Serializer for
StringData . |
class |
StringDataTypeInfo
TypeInformation for
StringData . |
class |
TimestampDataSerializer
Serializer for
TimestampData . |
class |
TimestampDataTypeInfo
TypeInformation for
TimestampData . |
Modifier and Type | Class and Description |
---|---|
class |
ArrayDataSerializer
A
TypeSerializer for ArrayData . |
class |
BigDecSerializer
We create the BigDecSerializer instead of using the BigDecSerializer of flink-core module for
performance reasons in Python deserialization.
|
class |
DateSerializer
Takes int instead of long as the serialized value.
|
class |
DecimalDataSerializer
We create the DecimalSerializer instead of using the DecimalSerializer of flink-table-runtime for
performance reasons in Python deserialization.
|
class |
MapDataSerializer
A
TypeSerializer for MapData . |
class |
RowDataSerializer
A
TypeSerializer for RowData . |
class |
StringSerializer
We create the StringSerializer instead of using the StringSerializer of flink-core module because
the StringSerializer of flink-core module serialize every Char of String in serialize method and
deserialize the Char to build the String.
|
class |
TimeSerializer
Uses int instead of long as the serialized value.
|
class |
TimestampSerializer
Uses similar serialization/deserialization of SqlTimestampSerializer to serialize Timestamp.
|
Modifier and Type | Class and Description |
---|---|
class |
StreamRecordCollector<T>
|
class |
TimeWindowUtil
Time util to deals window start and end in different timezone.
|
Modifier and Type | Class and Description |
---|---|
class |
CsvAppendTableSinkFactory
Deprecated.
The legacy CSV connector has been replaced by
FileSink . It is kept only to
support tests for the legacy connector stack. |
class |
CsvBatchTableSinkFactory
Deprecated.
The legacy CSV connector has been replaced by
FileSink . It is kept only to
support tests for the legacy connector stack. |
class |
CsvTableSink
Deprecated.
The legacy CSV connector has been replaced by
FileSink . It is kept only to
support tests for the legacy connector stack. |
class |
CsvTableSinkFactoryBase
Deprecated.
The legacy CSV connector has been replaced by
FileSink . It is kept only to
support tests for the legacy connector stack. |
class |
TableSinkBase<T>
Deprecated.
This class is implementing the deprecated
TableSink interface. Implement
DynamicTableSink directly instead. |
Modifier and Type | Class and Description |
---|---|
class |
CsvAppendTableSourceFactory
Deprecated.
The legacy CSV connector has been replaced by
FileSource . It is kept only to
support tests for the legacy connector stack. |
class |
CsvBatchTableSourceFactory
Deprecated.
The legacy CSV connector has been replaced by
FileSource . It is kept only to
support tests for the legacy connector stack. |
class |
CsvTableSource
Deprecated.
The legacy CSV connector has been replaced by
FileSource . It is kept only to
support tests for the legacy connector stack. |
class |
CsvTableSourceFactoryBase
Deprecated.
The legacy CSV connector has been replaced by
FileSource . It is kept only to
support tests for the legacy connector stack. |
class |
TableSourceValidation
Logic to validate
TableSource types. |
Modifier and Type | Class and Description |
---|---|
class |
TimestampExtractorUtils
Utility methods for dealing with
TimestampExtractor . |
Modifier and Type | Interface and Description |
---|---|
interface |
DataTypeQueryable
Indicates that a
DataType can be retrieved from a class that implements this interfaces. |
Modifier and Type | Class and Description |
---|---|
class |
DataTypeExtractor
|
class |
ExtractionUtils
Utilities for performing reflection tasks.
|
class |
TypeInferenceExtractor
Reflection-based utility for extracting a
TypeInference from a supported subclass of
UserDefinedFunction . |
Modifier and Type | Class and Description |
---|---|
class |
InputTypeStrategies
Strategies for inferring and validating input arguments in a function call.
|
class |
TypeInferenceUtil
Utility for performing type inference.
|
class |
TypeStrategies
Strategies for inferring an output or accumulator data type of a function call.
|
class |
TypeTransformations
Transformations for transforming one data type to another.
|
Modifier and Type | Class and Description |
---|---|
class |
AndArgumentTypeStrategy
Strategy for inferring and validating an argument using a conjunction of multiple
ArgumentTypeStrategy s into one like f(NUMERIC && LITERAL) |
class |
AnyArgumentTypeStrategy
Strategy for an argument that can be of any type.
|
class |
ArgumentMappingTypeStrategy
Type strategy that returns the n-th input argument, mapping it with the provided function.
|
class |
CommonArgumentTypeStrategy
Argument type strategy that checks and casts for a common, least restrictive type of all
arguments.
|
class |
CommonInputTypeStrategy
An
InputTypeStrategy that expects that all arguments have a common type. |
class |
CommonTypeStrategy
Type strategy that returns a common, least restrictive type of all arguments.
|
class |
ComparableTypeStrategy
An
InputTypeStrategy that checks if all input arguments can be compared with each other
with the minimal provided comparison. |
class |
CompositeArgumentTypeStrategy
Strategy that checks that the argument has a composite type.
|
class |
ConstraintArgumentTypeStrategy
Strategy for an argument that must fulfill a given constraint.
|
class |
ExplicitArgumentTypeStrategy
Strategy for an argument that corresponds to an explicitly defined type.
|
class |
ExplicitTypeStrategy
Type strategy that returns a fixed
DataType . |
class |
FamilyArgumentTypeStrategy
Strategy for an argument that corresponds to a given
LogicalTypeFamily and nullability. |
class |
FirstTypeStrategy
Type strategy that returns the first type that could be inferred.
|
class |
ForceNullableTypeStrategy
Forces a given type strategy to be nullable.
|
class |
LiteralArgumentTypeStrategy
Strategy that checks if an argument is a literal.
|
class |
MappingTypeStrategy
Type strategy that maps an
InputTypeStrategy to a TypeStrategy if the input
strategy infers compatible types. |
class |
MatchFamilyTypeStrategy
Type strategy that returns the given argument if it is of the same logical type family.
|
class |
MissingTypeStrategy
Placeholder for a missing type strategy.
|
class |
NullableIfArgsTypeStrategy
A type strategy that can be used to make a result type nullable if any or all of the selected
input arguments are nullable.
|
class |
OrArgumentTypeStrategy
Strategy for inferring and validating an argument using a disjunction of multiple
ArgumentTypeStrategy s into one like f(NUMERIC || STRING) . |
class |
OrInputTypeStrategy
Strategy for inferring and validating the input using a disjunction of multiple
InputTypeStrategy s into one like f(NUMERIC) || f(STRING) . |
class |
OutputArgumentTypeStrategy
Strategy for inferring an unknown argument type from the function's output
DataType if
available. |
class |
RepeatingSequenceInputTypeStrategy
InputTypeStrategy composed of an arbitrarily often repeating list of ArgumentTypeStrategy s. |
class |
RootArgumentTypeStrategy
Strategy for an argument that corresponds to a given
LogicalTypeRoot and nullability. |
class |
SequenceInputTypeStrategy
Strategy for inferring and validating a function signature like
f(STRING, NUMERIC) or
f(s STRING, n NUMERIC) using a sequence of ArgumentTypeStrategy s. |
class |
SpecificInputTypeStrategies
Entry point for specific input type strategies not covered in
InputTypeStrategies . |
class |
SpecificTypeStrategies
Entry point for specific type strategies not covered in
TypeStrategies . |
class |
SubsequenceInputTypeStrategy
An
InputTypeStrategy that lets you apply other strategies for subsequences of the actual
arguments. |
class |
SymbolArgumentTypeStrategy<T extends Enum<? extends TableSymbol>>
Strategy for a symbol argument of a specific
TableSymbol enum. |
class |
ToTimestampLtzTypeStrategy
Type strategy of
TO_TIMESTAMP_LTZ . |
class |
TypeLiteralArgumentTypeStrategy
Strategy that checks if an argument is a type literal.
|
class |
VaryingSequenceInputTypeStrategy
Strategy for inferring and validating a varying function signature like
f(INT, STRING,
NUMERIC...) or f(i INT, str STRING, num NUMERIC...) using a sequence of ArgumentTypeStrategy s. |
class |
VaryingStringTypeStrategy
A type strategy that ensures that the result type is either
LogicalTypeRoot.VARCHAR or
LogicalTypeRoot.VARBINARY from their corresponding non-varying roots. |
class |
WildcardInputTypeStrategy
Strategy that does not perform any modification or validation of the input.
|
Modifier and Type | Class and Description |
---|---|
class |
DataTypeConversionClassTransformation
This type transformation transforms the specified data types to a new one with the expected
conversion class.
|
class |
LegacyToNonLegacyTransformation
Transformation that applies
TypeInfoDataTypeConverter on LegacyTypeInformationType . |
Modifier and Type | Class and Description |
---|---|
class |
AdaptedCallContext
Helper context that deals with adapted arguments.
|
class |
UnknownCallContext
A
CallContext with unknown data types. |
Modifier and Type | Class and Description |
---|---|
class |
LegacyTypeInformationType<T>
This type is a temporary solution to fully support the old type system stack through the new
stack.
|
class |
TimestampKind
Internal timestamp kind for attaching time attribute metadata to timestamps with or without a
time zone.
|
Modifier and Type | Method and Description |
---|---|
TimestampKind |
ZonedTimestampType.getKind() |
TimestampKind |
TimestampType.getKind() |
TimestampKind |
LocalZonedTimestampType.getKind() |
RawType<T> |
TypeInformationRawType.resolve(ExecutionConfig config)
Deprecated.
|
Constructor and Description |
---|
LocalZonedTimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
TimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
ZonedTimestampType(boolean isNullable,
TimestampKind kind,
int precision)
Internal constructor that allows attaching additional metadata about time attribute
properties.
|
Modifier and Type | Class and Description |
---|---|
class |
LogicalTypeCasts
Utilities for casting
LogicalType . |
class |
LogicalTypeChecks
Utilities for checking
LogicalType and avoiding a lot of type casting and repetitive
work. |
class |
LogicalTypeDefaultVisitor<R>
Implementation of
LogicalTypeVisitor that redirects all calls to LogicalTypeDefaultVisitor.defaultMethod(LogicalType) . |
class |
LogicalTypeDuplicator
Returns a deep copy of a
LogicalType . |
class |
LogicalTypeMerging
Utilities for merging multiple
LogicalType . |
class |
LogicalTypeUtils
Utilities for handling
LogicalType s. |
Modifier and Type | Class and Description |
---|---|
class |
ClassDataTypeConverter
Class-based data type extractor that supports extraction of clearly identifiable data types for
input and output conversion.
|
class |
DataTypeDefaultVisitor<R>
Implementation of
DataTypeVisitor that redirects all calls to DataTypeDefaultVisitor.defaultMethod(DataType) . |
class |
DataTypeUtils
Utilities for handling
DataType s. |
class |
LegacyTypeInfoDataTypeConverter
Deprecated.
Use
DataTypeFactory.createDataType(TypeInformation) instead. Note that this
method will not create legacy types anymore. It fully uses the new type system available only
in the planner. |
class |
TypeConversions
|
class |
TypeInfoDataTypeConverter
Converter from
TypeInformation to DataType . |
class |
ValueDataTypeConverter
Value-based data type extractor that supports extraction of clearly identifiable data types for
input conversion.
|
Modifier and Type | Class and Description |
---|---|
class |
TimeIndicatorTypeInfo
Deprecated.
This class will be removed in future versions as it is used for the old type system.
It is recommended to use
DataTypes instead. Please make sure to use either the old or
the new type system consistently to avoid unintended behavior. See the website documentation
for more information. |
class |
TimeIntervalTypeInfo<T>
Deprecated.
This class will be removed in future versions as it is used for the old type system.
It is recommended to use
DataTypes instead. Please make sure to use either the old or
the new type system consistently to avoid unintended behavior. See the website documentation
for more information. |
Modifier and Type | Class and Description |
---|---|
class |
DateTimeUtils
Utility functions for datetime types: date, time, timestamp.
|
class |
EncodingUtils
General utilities for string-encoding.
|
class |
PartitionPathUtils
Utils for file system.
|
class |
TableConnectorUtils
Utilities for table sources and sinks.
|
class |
TableSchemaUtils
Utilities to
TableSchema . |
class |
ThreadLocalCache<K,V>
Provides a thread local cache with a maximum cache size per thread.
|
class |
TypeMappingUtils
Utility methods for dealing with field types in
TableSource and TableSink . |
Modifier and Type | Interface and Description |
---|---|
interface |
PrintStyle
A
PrintStyle defines style and formatting to print a collection of RowData . |
class |
RawContentStyle
Print only the result content as raw form.
|
interface |
RowDataToStringConverter
|
class |
TableauStyle
Print the result and content as tableau form.
|
Modifier and Type | Class and Description |
---|---|
class |
PythonTableUtils
Python utilities.
|
Modifier and Type | Class and Description |
---|---|
class |
TestingSecurityContext
Test security context to support handling both client and server principals in MiniKDC.
|
Modifier and Type | Method and Description |
---|---|
static Row |
RowUtils.createRowWithNamedPositions(RowKind kind,
Object[] fieldByPosition,
LinkedHashMap<String,Integer> positionByName)
Internal utility for creating a row in static named-position field mode.
|
static <L,R> Either.Left<L,R> |
Either.obtainLeft(Either<L,R> input,
TypeSerializer<L> leftSerializer)
Utility function for
EitherSerializer to support object reuse. |
static <L,R> Either.Right<L,R> |
Either.obtainRight(Either<L,R> input,
TypeSerializer<R> rightSerializer)
Utility function for
EitherSerializer to support object reuse. |
Modifier and Type | Class and Description |
---|---|
class |
AbstractAutoCloseableRegistry<R extends AutoCloseable,C extends R,T,E extends Exception>
This is the abstract base class for registries that allow to register instances of
Closeable , which are all closed if this registry is closed. |
class |
ArrayUtils
Utility class for Java arrays.
|
class |
ClassLoaderUtil
Utilities for information with respect to class loaders, specifically class loaders for the
dynamic loading of user defined classes.
|
class |
CollectionUtil
Simple utility to work with Java collections.
|
class |
CompressedSerializedValue<T>
An extension of
SerializedValue that compresses the value after the serialization. |
class |
ExceptionUtils
A collection of utility functions for dealing with exceptions and exception workflows.
|
class |
FileLock
A file lock used for avoiding race condition among multiple threads/processes.
|
class |
FlinkUserCodeClassLoaders
Gives the URLClassLoader a nicer name for debugging purposes.
|
static class |
FlinkUserCodeClassLoaders.ParentFirstClassLoader
Regular URLClassLoader that first loads from the parent and only after that from the URLs.
|
static class |
FlinkUserCodeClassLoaders.SafetyNetWrapperClassLoader
Ensures that holding a reference on the context class loader outliving the scope of user code
does not prevent the user classloader to be garbage collected (FLINK-16245).
|
class |
InstantiationUtil
Utility class to create instances from class objects and checking failure reasons.
|
interface |
IterableIterator<E>
|
class |
JarUtils
Utility functions for jar files.
|
class |
LinkedOptionalMap<K,V>
A LinkedOptionalMap is an order preserving map (like
LinkedHashMap ) where keys have a
unique string name, but are optionally present, and the values are optional. |
class |
LinkedOptionalMapSerializer
LinkedOptionalMapSerializer - A serializer of
LinkedOptionalMap . |
interface |
MutableObjectIterator<E>
A simple iterator interface.
|
class |
MutableURLClassLoader
URL class loader that exposes the `addURL` method in URLClassLoader.
|
class |
NetUtils
Utility for various network related tasks (such as finding free ports).
|
class |
OperatingSystem
An enumeration indicating the operating system that the JVM runs on.
|
class |
OptionalUtils
Utilities for working with
Optional . |
class |
Preconditions
A collection of static utility methods to validate input.
|
interface |
RefCounted
Interface to simply add reference counting functionality.
|
class |
ReflectionUtil
Utility for reflection operations on classes and generic type parametrization.
|
class |
SerializedValue<T>
This class is used to transfer (via serialization) objects whose classes are not available in the
system class loader.
|
class |
UnionIterator<T>
An iterator that concatenates a collection of iterators.
|
interface |
Visitable<T extends Visitable<T>>
This interface marks types as visitable during a traversal.
|
interface |
Visitor<T extends Visitable<T>>
A visitor encapsulates functionality that is applied to each node in the process of a traversal
of a tree or DAG.
|
interface |
WrappingProxy<T>
Interface for objects that wrap another object and proxy (possibly a subset) of the methods of
that object.
|
class |
WrappingProxyUtil
Utilities for working with
WrappingProxy . |
Modifier and Type | Method and Description |
---|---|
static <K,V,G extends Iterable<K>> |
IterableUtils.flatMap(Iterable<G> itemGroups,
java.util.function.Function<K,V> mapper)
|
Modifier and Type | Class and Description |
---|---|
class |
NeverCompleteFuture
A future that never completes.
|
Modifier and Type | Class and Description |
---|---|
class |
FutureTaskWithException<V>
FutureTask that also implements RunnableWithException . |
Modifier and Type | Class and Description |
---|---|
class |
LoggerOutputFormat
A basic output format that logs all records at level INFO.
|
Modifier and Type | Class and Description |
---|---|
class |
TransactionRowInputFormat
An bounded input of transactions.
|
Modifier and Type | Class and Description |
---|---|
class |
YarnClusterClientFactory
A
ClusterClientFactory for a YARN cluster. |
Modifier and Type | Class and Description |
---|---|
class |
FallbackYarnSessionCli
A stub Yarn Command Line to throw an exception with the correct message when the
HADOOP_CLASSPATH is not set. |
Modifier and Type | Class and Description |
---|---|
class |
YarnConfigOptionsInternal
Yarn configuration options that are not meant to be set by the user.
|
class |
YarnDeploymentTarget
A class containing all the supported deployment target names for Yarn.
|
class |
YarnLogConfigUtil
A class with utilities for setting the log config file.
|
Modifier and Type | Class and Description |
---|---|
class |
YarnApplicationClusterEntryPoint
An
ApplicationClusterEntryPoint for Yarn. |
Modifier and Type | Class and Description |
---|---|
class |
YarnJobClusterExecutor
Deprecated.
|
class |
YarnJobClusterExecutorFactory
Deprecated.
|
class |
YarnSessionClusterExecutor
The
PipelineExecutor to be used when executing a job on an already running cluster. |
class |
YarnSessionClusterExecutorFactory
An
PipelineExecutorFactory for executing jobs on an existing (session) cluster. |
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.