Uses of Class
org.apache.flink.annotation.Internal
-
-
Uses of Internal in org.apache.calcite.sql.validate
Classes in org.apache.calcite.sql.validate with annotations of type Internal Modifier and Type Class Description class
ProcedureNamespace
Namespace whose contents are defined by the result of a call to a user-defined procedure. -
Uses of Internal in org.apache.flink.annotation
Classes in org.apache.flink.annotation with annotations of type Internal Modifier and Type Class Description interface
VisibleForTesting
This annotations declares that a function, field, constructor, or entire type, is only visible for testing purposes. -
Uses of Internal in org.apache.flink.annotation.docs
Classes in org.apache.flink.annotation.docs with annotations of type Internal Modifier and Type Class Description interface
ConfigGroup
A class that specifies a group of config options.interface
ConfigGroups
Annotation used on classes containing config options that enables the separation of options into different tables based on key prefixes.static interface
Documentation.ExcludeFromDocumentation
Annotation used on config option fields or REST API message headers to exclude it from documentation.static interface
Documentation.OverrideDefault
Annotation used on config option fields to override the documented default.static interface
Documentation.Section
Annotation used on config option fields to include them in specific sections.static interface
Documentation.SuffixOption
Annotation used on config option fields or options class to mark them as a suffix-option; i.e., a config option where the key is only a suffix, with the prefix being dynamically provided at runtime.static interface
Documentation.TableOption
Annotation used on table config options for adding meta data labels.class
FlinkJsonSchema
Annotations for auto-generating a documentation of json payloads.static interface
FlinkJsonSchema.AdditionalFields
This allows documenting a class that supports setting dynamic properties of a certain type. -
Uses of Internal in org.apache.flink.api.common
Classes in org.apache.flink.api.common with annotations of type Internal Modifier and Type Interface Description interface
Archiveable<T extends Serializable>
class
ArchivedExecutionConfig
Serializable class which is created when archiving the job.class
JobInfoImpl
The default implementation ofJobInfo
.class
Plan
This class represents Flink programs, in the form of dataflow plans.class
RestartStrategyDescriptionUtils
Utility class for describing restart strategies.class
SerializableSerializer<T extends com.esotericsoftware.kryo.Serializer<?> & Serializable>
The wrapper to make serializer serializable.class
TaskInfoImpl
The default implementation ofTaskInfo
.Methods in org.apache.flink.api.common with annotations of type Internal Modifier and Type Method Description ArchivedExecutionConfig
ExecutionConfig. archive()
void
ExecutionConfig. enablePeriodicMaterialize(boolean enabled)
int
ExecutionConfig. getMaterializationMaxAllowedFailures()
long
ExecutionConfig. getPeriodicMaterializeIntervalMillis()
Optional<JobManagerOptions.SchedulerType>
ExecutionConfig. getSchedulerType()
SerializerConfig
ExecutionConfig. getSerializerConfig()
boolean
ExecutionConfig. isLatencyTrackingConfigured()
boolean
ExecutionConfig. isPeriodicMaterializeEnabled()
void
ExecutionConfig. resetParallelism()
void
ExecutionConfig. setMaterializationMaxAllowedFailures(int materializationMaxAllowedFailures)
void
ExecutionConfig. setPeriodicMaterializeIntervalMillis(Duration periodicMaterializeInterval)
Configuration
ExecutionConfig. toConfiguration()
Constructors in org.apache.flink.api.common with annotations of type Internal Constructor Description ExecutionConfig(Configuration configuration)
-
Uses of Internal in org.apache.flink.api.common.accumulators
Classes in org.apache.flink.api.common.accumulators with annotations of type Internal Modifier and Type Class Description class
AccumulatorHelper
Helper functions for the interaction withAccumulator
. -
Uses of Internal in org.apache.flink.api.common.aggregators
Classes in org.apache.flink.api.common.aggregators with annotations of type Internal Modifier and Type Class Description class
AggregatorRegistry
A registry for iterationAggregator
s. -
Uses of Internal in org.apache.flink.api.common.attribute
Classes in org.apache.flink.api.common.attribute with annotations of type Internal Modifier and Type Class Description class
Attribute
Attribute
contains the information about the process logic of a process function.static class
Attribute.Builder
-
Uses of Internal in org.apache.flink.api.common.cache
Methods in org.apache.flink.api.common.cache with annotations of type Internal Modifier and Type Method Description static List<String>
DistributedCache. parseStringFromCachedFiles(List<Tuple2<String,DistributedCache.DistributedCacheEntry>> files)
-
Uses of Internal in org.apache.flink.api.common.distributions
Classes in org.apache.flink.api.common.distributions with annotations of type Internal Modifier and Type Class Description class
CommonRangeBoundaries<T>
-
Uses of Internal in org.apache.flink.api.common.eventtime
Classes in org.apache.flink.api.common.eventtime with annotations of type Internal Modifier and Type Class Description class
IndexedCombinedWatermarkStatus
Represents combined value and status of a watermark for a set number of input partial watermarks.class
WatermarkOutputMultiplexer
AWatermarkOutputMultiplexer
combines the watermark (and idleness) updates of multiple partitions/shards/splits into one combined watermark update and forwards it to an underlyingWatermarkOutput
.static interface
WatermarkOutputMultiplexer.WatermarkUpdateListener
A callback for propagating changes to split based watermarks. -
Uses of Internal in org.apache.flink.api.common.functions
Classes in org.apache.flink.api.common.functions with annotations of type Internal Modifier and Type Interface Description interface
SerializerFactory
A factory forTypeSerializer
implementations.class
WrappingFunction<T extends Function>
Wrapper aroundFunction
. -
Uses of Internal in org.apache.flink.api.common.functions.util
Classes in org.apache.flink.api.common.functions.util with annotations of type Internal Modifier and Type Class Description class
AbstractRuntimeUDFContext
A standalone implementation of theRuntimeContext
, created by runtime UDF operators.class
CopyingIterator<E>
Wraps an iterator to return deep copies of the original iterator's elements.class
CopyingListCollector<T>
ACollector
that collects deep copies of its elements in a list.class
FunctionUtils
Utility class that contains helper methods to work with FlinkFunction
class.class
ListCollector<T>
ACollector
that puts the collected elements into a given list.class
NoOpFunction
AnAbstractRichFunction
that does nothing.class
PrintSinkOutputWriter<IN>
Print sink output writer for DataStream and DataSet print API.class
RuntimeUDFContext
A standalone implementation of theRuntimeContext
, created by runtime UDF operators.Methods in org.apache.flink.api.common.functions.util with annotations of type Internal Modifier and Type Method Description String
AbstractRuntimeUDFContext. getAllocationIDAsString()
-
Uses of Internal in org.apache.flink.api.common.io
Classes in org.apache.flink.api.common.io with annotations of type Internal Modifier and Type Class Description class
DefaultInputSplitAssigner
This is the default implementation of theInputSplitAssigner
interface.class
GenericCsvInputFormat<OT>
class
GlobFilePathFilter
Class for determining if a particular file should be included or excluded based on a set of include and exclude glob filters.class
ReplicatingInputSplitAssigner
Assigns each InputSplit to each requesting parallel instance. -
Uses of Internal in org.apache.flink.api.common.io.compression
Classes in org.apache.flink.api.common.io.compression with annotations of type Internal Modifier and Type Class Description class
Bzip2InputStreamFactory
Factory for Bzip2 decompressors.class
DeflateInflaterInputStreamFactory
Factory for input streams that decompress the "deflate" compression format.class
GzipInflaterInputStreamFactory
Factory for input streams that decompress the GZIP compression format.interface
InflaterInputStreamFactory<T extends InputStream>
Creates a new instance of a certain subclass ofInflaterInputStream
.class
XZInputStreamFactory
Factory for XZ decompressors.class
ZStandardInputStreamFactory
Factory for ZStandard decompressors. -
Uses of Internal in org.apache.flink.api.common.operators
Classes in org.apache.flink.api.common.operators with annotations of type Internal Modifier and Type Class Description class
AbstractUdfOperator<OUT,FT extends Function>
Abstract superclass for all contracts that represent actual operators.class
BinaryOperatorInformation<IN1,IN2,OUT>
A class for holding information about a single input operator, such as input/output TypeInformation.class
CollectionExecutor
Execution utility for serial, local, collection-based executions of Flink programs.class
CompilerHints
A class encapsulating compiler hints describing the behavior of the user function.class
DualInputOperator<IN1,IN2,OUT,FT extends Function>
Abstract operator superclass for all operators that have two inputs, like "Join", "CoGroup", or "Cross".class
DualInputSemanticProperties
Container for the semantic properties associated to a dual input operator.class
GenericDataSinkBase<IN>
Operator for nodes that act as data sinks, storing the data they receive.class
GenericDataSourceBase<OUT,T extends InputFormat<OUT,?>>
Abstract superclass for data sources in a Pact plan.interface
IterationOperator
class
Keys<T>
class
MailOptionsImpl
Options to configure behaviour of executing mailbox mails.class
Operator<OUT>
Abstract base class for all operators.class
OperatorInformation<OUT>
A class for holding information about an operator, such as input/output TypeInformation.class
Ordering
This class represents an ordering on a set of fields.class
ResourceSpec
Describe the different resource factors of the operator with UDF.interface
SemanticProperties
Container for the semantic properties associated to an operator.class
SingleInputOperator<IN,OUT,FT extends Function>
Abstract superclass for all operators that have one input like "map" or "reduce".class
SingleInputSemanticProperties
Container for the semantic properties associated to a single input operator.class
UnaryOperatorInformation<IN,OUT>
A class for holding information about a single input operator, such as input/output TypeInformation.class
Union<T>
This operator represents a Union between two inputs. -
Uses of Internal in org.apache.flink.api.common.operators.base
Classes in org.apache.flink.api.common.operators.base with annotations of type Internal Modifier and Type Class Description class
BulkIterationBase<T>
class
CoGroupOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>>
class
CoGroupRawOperatorBase<IN1,IN2,OUT,FT extends CoGroupFunction<IN1,IN2,OUT>>
class
CrossOperatorBase<IN1,IN2,OUT,FT extends CrossFunction<IN1,IN2,OUT>>
class
DeltaIterationBase<ST,WT>
A DeltaIteration is similar to aBulkIterationBase
, but maintains state across the individual iteration steps.class
FilterOperatorBase<T,FT extends FlatMapFunction<T,T>>
class
FlatMapOperatorBase<IN,OUT,FT extends FlatMapFunction<IN,OUT>>
class
GroupCombineOperatorBase<IN,OUT,FT extends GroupCombineFunction<IN,OUT>>
Base operator for the combineGroup transformation.class
GroupReduceOperatorBase<IN,OUT,FT extends GroupReduceFunction<IN,OUT>>
class
InnerJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>>
class
JoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>>
class
MapOperatorBase<IN,OUT,FT extends MapFunction<IN,OUT>>
class
MapPartitionOperatorBase<IN,OUT,FT extends MapPartitionFunction<IN,OUT>>
class
OuterJoinOperatorBase<IN1,IN2,OUT,FT extends FlatJoinFunction<IN1,IN2,OUT>>
class
PartitionOperatorBase<IN>
class
ReduceOperatorBase<T,FT extends ReduceFunction<T>>
Base data flow operator for Reduce user-defined functions.class
SortPartitionOperatorBase<IN>
-
Uses of Internal in org.apache.flink.api.common.operators.util
Classes in org.apache.flink.api.common.operators.util with annotations of type Internal Modifier and Type Class Description class
FieldList
Immutable ordered list of fields IDs.class
FieldSet
Immutable unordered collection of fields IDs.class
JoinHashMap<BT>
class
ListKeyGroupedIterator<E>
The KeyValueIterator returns a key and all values that belong to the key (share the same key).class
TupleUnwrappingIterator<T,K>
An iterator that reads 2-tuples (key value pairs) and returns only the values (second field).class
TypeComparable<T>
Wrapper that is used to store elements for which we have a TypeComparator in a Hash Map.class
UserCodeClassWrapper<T>
This holds a class containing user defined code.class
UserCodeObjectWrapper<T>
This holds an actual object containing user defined code.interface
UserCodeWrapper<T>
UDf operators can have either a class or an object containing the user code, this is the common interface to access them. -
Uses of Internal in org.apache.flink.api.common.resources
Classes in org.apache.flink.api.common.resources with annotations of type Internal Modifier and Type Class Description class
CPUResource
Represents CPU resource.class
ExternalResource
An external resource.class
Resource<T extends Resource<T>>
Base class for resources one can specify. -
Uses of Internal in org.apache.flink.api.common.serialization
Classes in org.apache.flink.api.common.serialization with annotations of type Internal Modifier and Type Class Description class
RuntimeContextInitializationContextAdapters
A set of adapters betweenRuntimeContext
andDeserializationSchema.InitializationContext
orSerializationSchema.InitializationContext
.class
SerializerConfigImpl
The default implement ofSerializerConfig
.Methods in org.apache.flink.api.common.serialization with annotations of type Internal Modifier and Type Method Description void
SerializerConfig. addDefaultKryoSerializer(Class<?> type, Class<? extends com.esotericsoftware.kryo.Serializer<?>> serializerClass)
Adds a new Kryo default serializer to the Runtime.<T extends com.esotericsoftware.kryo.Serializer<?> & Serializable>
voidSerializerConfig. addDefaultKryoSerializer(Class<?> type, T serializer)
Adds a new Kryo default serializer to the Runtime.void
SerializerConfig. registerKryoType(Class<?> type)
Registers the given type with the serialization stack.void
SerializerConfig. registerPojoType(Class<?> type)
Registers the given type with the serialization stack.void
SerializerConfig. registerTypeWithKryoSerializer(Class<?> type, Class<? extends com.esotericsoftware.kryo.Serializer> serializerClass)
Registers the given Serializer via its class as a serializer for the given type at the KryoSerializer.<T extends com.esotericsoftware.kryo.Serializer<?> & Serializable>
voidSerializerConfig. registerTypeWithKryoSerializer(Class<?> type, T serializer)
Registers the given type with a Kryo Serializer.void
SerializerConfig. setForceAvro(boolean forceAvro)
The method will be converted to private in the next Flink major version after removing its deprecated caller methods.void
SerializerConfig. setForceKryo(boolean forceKryo)
The method will be converted to private in the next Flink major version after removing its deprecated caller methods.void
SerializerConfig. setForceKryoAvro(boolean forceKryoAvro)
The method will be converted to private in the next Flink major version after removing its deprecated caller methods.void
SerializerConfig. setGenericTypes(boolean genericTypes)
The method will be converted to private in the next Flink major version after removing its deprecated caller methods.Constructors in org.apache.flink.api.common.serialization with annotations of type Internal Constructor Description SerializerConfigImpl(Configuration configuration)
-
Uses of Internal in org.apache.flink.api.common.state
Classes in org.apache.flink.api.common.state with annotations of type Internal Modifier and Type Interface Description interface
InternalCheckpointListener
The internal checkpoint listener add anotherInternalCheckpointListener.notifyCheckpointSubsumed(long)
interface for internal usage.Methods in org.apache.flink.api.common.state with annotations of type Internal Modifier and Type Method Description StateTtlConfig
StateDescriptor. getTtlConfig()
void
StateDescriptor. initializeSerializerUnlessSet(SerializerFactory serializerFactory)
-
Uses of Internal in org.apache.flink.api.common.time
Classes in org.apache.flink.api.common.time with annotations of type Internal Modifier and Type Class Description class
Deadline
This class stores a deadline, as obtained viaDeadline.now()
or fromDeadline.plus(Duration)
. -
Uses of Internal in org.apache.flink.api.common.typeinfo.descriptor
Classes in org.apache.flink.api.common.typeinfo.descriptor with annotations of type Internal Modifier and Type Class Description class
BasicTypeDescriptorImpl<T>
Implementation ofTypeDescriptor
to createBasicTypeInfo
.class
ListTypeDescriptorImpl<T>
Implementation ofTypeDescriptor
to createListTypeInfo
.class
MapTypeDescriptorImpl<K,V>
Implementation ofTypeDescriptor
to createMapTypeInfo
.class
ValueTypeDescriptorImpl<T extends Value>
Implementation ofTypeDescriptor
to createValueTypeInfo
. -
Uses of Internal in org.apache.flink.api.common.typeutils
Classes in org.apache.flink.api.common.typeutils with annotations of type Internal Modifier and Type Class Description class
CompositeTypeSerializerUtil
Utilities for theCompositeTypeSerializerSnapshot
.class
GenericPairComparator<T1,T2>
class
GenericTypeSerializerSnapshot<T,S extends TypeSerializer>
BaseTypeSerializerSnapshot
for serializers for generic types.interface
LegacySerializerSnapshotTransformer<T>
This interface provides a way forTypeSerializer
s to transform a legacyTypeSerializerSnapshot
used in versions before Flink 1.7 during deserialization.class
NestedSerializersSnapshotDelegate
A NestedSerializersSnapshotDelegate represents the snapshots of multiple serializers that are used by an outer serializer.class
SameTypePairComparator<T>
class
SingleThreadAccessCheckingTypeSerializer<T>
interface
TypeComparatorFactory<T>
class
TypePairComparator<T1,T2>
This interface defines the method required by the runtime to use data types in join-like operations.interface
TypePairComparatorFactory<T1,T2>
interface
TypeSerializerFactory<T>
-
Uses of Internal in org.apache.flink.api.common.typeutils.base
Classes in org.apache.flink.api.common.typeutils.base with annotations of type Internal Modifier and Type Class Description class
BasicTypeComparator<T extends Comparable<T>>
class
BigDecComparator
Comparator for comparing BigDecimal values.class
BigDecSerializer
Serializer for serializing/deserializing BigDecimal values including null values.class
BigIntComparator
Comparator for comparing BigInteger values.class
BigIntSerializer
Serializer for serializing/deserializing BigInteger values including null values.class
BooleanComparator
class
BooleanSerializer
Type serializer forBoolean
.class
BooleanValueComparator
Specialized comparator for BooleanValue based on CopyableValueComparator.class
BooleanValueSerializer
class
ByteComparator
class
ByteSerializer
Type serializer forByte
.class
ByteValueComparator
Specialized comparator for ByteValue based on CopyableValueComparator.class
ByteValueSerializer
class
CharComparator
class
CharSerializer
Type serializer forCharacter
.class
CharValueComparator
Specialized comparator for CharValue based on CopyableValueComparator.class
CharValueSerializer
class
DateComparator
class
DateSerializer
class
DoubleComparator
class
DoubleSerializer
Type serializer forDouble
.class
DoubleValueComparator
Specialized comparator for DoubleValue based on CopyableValueComparator.class
DoubleValueSerializer
class
EnumComparator<T extends Enum<T>>
class
EnumSerializer<T extends Enum<T>>
TypeSerializer
for Java enums.class
FloatComparator
class
FloatSerializer
Type serializer forFloat
.class
FloatValueComparator
Specialized comparator for FloatValue based on CopyableValueComparator.class
FloatValueSerializer
class
GenericArraySerializer<C>
A serializer for arrays of objects.class
InstantComparator
Comparator for comparing Java Instant.class
InstantSerializer
Serializer for serializing/deserializing Instant values including null values.class
IntComparator
class
IntSerializer
Type serializer forInteger
(andint
, via auto-boxing).class
IntValueComparator
Specialized comparator for IntValue based on CopyableValueComparator.class
IntValueSerializer
class
ListSerializer<T>
A serializer forLists
.class
LocalDateComparator
This class can not extendBasicTypeComparator
, because LocalDate is a Comparable of ChronoLocalDate instead of Comparable of LocalDate.class
LocalDateSerializer
class
LocalDateTimeComparator
This class can not extendBasicTypeComparator
, because LocalDateTime is a Comparable of ChronoLocalDateTime instead of Comparable of LocalDateTime.class
LocalDateTimeSerializer
class
LocalTimeComparator
class
LocalTimeSerializer
class
LongComparator
class
LongSerializer
Type serializer forLong
.class
LongValueComparator
Specialized comparator for LongValue based on CopyableValueComparator.class
LongValueSerializer
class
MapSerializer<K,V>
A serializer forMap
.class
NormalizedKeyUtil
Utilities related toTypeComparator
.class
NullValueComparator
Specialized comparator for NullValue based on CopyableValueComparator.class
NullValueSerializer
class
ShortComparator
class
ShortSerializer
Type serializer forByte
.class
ShortValueComparator
Specialized comparator for ShortValue based on CopyableValueComparator.class
ShortValueSerializer
class
SqlDateSerializer
class
SqlTimeSerializer
class
SqlTimestampComparator
Comparator for comparing Java SQL Timestamps.class
SqlTimestampSerializer
class
StringComparator
class
StringSerializer
Type serializer forString
.class
StringValueComparator
Specialized comparator for StringValue based on CopyableValueComparator.class
StringValueSerializer
class
TypeSerializerSingleton<T>
class
VoidSerializer
Serializer forVoid
. -
Uses of Internal in org.apache.flink.api.common.typeutils.base.array
-
Uses of Internal in org.apache.flink.api.connector.dsv2
Classes in org.apache.flink.api.connector.dsv2 with annotations of type Internal Modifier and Type Class Description class
FromDataSource<T>
DataStream v2 source that emit data from pre-provided data.class
WrappedSink<T>
A simpleSink
implementation that wrap a sink-v2 based sink.class
WrappedSource<T>
A simpleSource
implementation that wrap a FLIP-27 source. -
Uses of Internal in org.apache.flink.api.connector.sink2
Classes in org.apache.flink.api.connector.sink2 with annotations of type Internal Modifier and Type Interface Description interface
InitContext
Common interface which exposes runtime info for creatingSinkWriter
andCommitter
objects. -
Uses of Internal in org.apache.flink.api.connector.source
Classes in org.apache.flink.api.connector.source with annotations of type Internal Modifier and Type Interface Description interface
SupportsIntermediateNoMoreSplits
A decorative interface ofSplitEnumeratorContext
which allows to handle intermediate NoMoreSplits. -
Uses of Internal in org.apache.flink.api.connector.source.util.ratelimit
Classes in org.apache.flink.api.connector.source.util.ratelimit with annotations of type Internal Modifier and Type Class Description class
GatedRateLimiter
An implementation ofRateLimiter
that completes defined number of futures in-between the external notification events.class
GuavaRateLimiter
An implementation ofRateLimiter
based on Guava's RateLimiter.class
NoOpRateLimiter
A convenience implementation ofRateLimiter
that does not throttle requests. -
Uses of Internal in org.apache.flink.api.dag
Classes in org.apache.flink.api.dag with annotations of type Internal Modifier and Type Interface Description interface
Pipeline
Common interface for Flink pipelines.class
Transformation<T>
ATransformation
represents the operation that creates a DataStream. -
Uses of Internal in org.apache.flink.api.java
Classes in org.apache.flink.api.java with annotations of type Internal Modifier and Type Class Description class
ClosureCleaner
The closure cleaner is a utility that tries to truncate the closure (enclosing instance) of non-static inner classes (created for inline transformation functions). -
Uses of Internal in org.apache.flink.api.java.functions
Classes in org.apache.flink.api.java.functions with annotations of type Internal Modifier and Type Class Description class
NullByteKeySelector<T>
Used as a dummyKeySelector
to allow using keyed operators for non-keyed use cases. -
Uses of Internal in org.apache.flink.api.java.hadoop.common
Classes in org.apache.flink.api.java.hadoop.common with annotations of type Internal Modifier and Type Class Description class
HadoopInputFormatCommonBase<T,SPITTYPE extends InputSplit>
A common base for both "mapred" and "mapreduce" Hadoop input formats.class
HadoopOutputFormatCommonBase<T>
A common base for both "mapred" and "mapreduce" Hadoop output formats. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapred
Classes in org.apache.flink.api.java.hadoop.mapred with annotations of type Internal Modifier and Type Class Description class
HadoopInputFormatBase<K,V,T>
Common base for Java and Scala API for using Hadoop input formats with Flink.class
HadoopOutputFormatBase<K,V,T>
Common base for the mapred HadoopOutputFormat wrappers. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapred.utils
Classes in org.apache.flink.api.java.hadoop.mapred.utils with annotations of type Internal Modifier and Type Class Description class
HadoopUtils
Utility class to work with Apache Hadoop MapRed classes. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapred.wrapper
Classes in org.apache.flink.api.java.hadoop.mapred.wrapper with annotations of type Internal Modifier and Type Class Description class
HadoopInputSplit
A wrapper that represents an input split from the Hadoop mapred API as a FlinkInputSplit
. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapreduce
Classes in org.apache.flink.api.java.hadoop.mapreduce with annotations of type Internal Modifier and Type Class Description class
HadoopInputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink.class
HadoopOutputFormatBase<K,V,T>
Base class shared between the Java and Scala API of Flink. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapreduce.utils
Classes in org.apache.flink.api.java.hadoop.mapreduce.utils with annotations of type Internal Modifier and Type Class Description class
HadoopUtils
Utility class to work with next generation of Apache Hadoop MapReduce classes. -
Uses of Internal in org.apache.flink.api.java.hadoop.mapreduce.wrapper
Classes in org.apache.flink.api.java.hadoop.mapreduce.wrapper with annotations of type Internal Modifier and Type Class Description class
HadoopInputSplit
A wrapper that represents an input split from the Hadoop mapreduce API as a FlinkInputSplit
. -
Uses of Internal in org.apache.flink.api.java.typeutils
Classes in org.apache.flink.api.java.typeutils with annotations of type Internal Modifier and Type Class Description class
PojoField
Represent a field definition forPojoTypeInfo
type of objects.class
TypeExtractionException
Type extraction always contains some uncertainty due to unpredictable JVM differences between vendors or versions.class
TypeExtractionUtils
Methods in org.apache.flink.api.java.typeutils with annotations of type Internal Modifier and Type Method Description static <OUT> TypeInfoFactory<OUT>
TypeExtractor. getTypeInfoFactory(Field field)
Returns the type information factory for an annotated field.static <OUT> TypeInfoFactory<OUT>
TypeExtractor. getTypeInfoFactory(Type t)
Returns the type information factory for a type using the factory registry or annotations.static void
TypeExtractor. registerFactory(Type t, Class<? extends TypeInfoFactory<?>> factory)
Registers a type information factory globally for a certain type. -
Uses of Internal in org.apache.flink.api.java.typeutils.runtime
Classes in org.apache.flink.api.java.typeutils.runtime with annotations of type Internal Modifier and Type Class Description class
CopyableValueComparator<T extends CopyableValue<T> & Comparable<T>>
Comparator for all Value types that extend Keyclass
CopyableValueSerializer<T extends CopyableValue<T>>
class
DataInputViewStream
An input stream that draws its data from aDataInputView
.class
DataOutputViewStream
class
EitherSerializer<L,R>
ATypeSerializer
for theEither
type of the Java class.class
FieldSerializer
This class is for the serialization of java.lang.reflect.Field, which doesn't implement Serializable, therefore readObject/writeObject need to be implemented in classes where there is a field of type java.lang.reflect.Field.class
GenericTypeComparator<T extends Comparable<T>>
TypeComparator for all types that extend Comparable.class
KryoRegistration
AKryoRegistration
resembles a registered class and its serializer in Kryo.class
KryoUtils
Convenience methods for Kryoclass
MaskUtils
Utilities for reading and writing binary masks.class
NoFetchingInput
class
NullAwareComparator<T>
Null-aware comparator that wraps a comparator which does not support null references.class
PojoComparator<T>
class
PojoSerializer<T>
class
PojoSerializerSnapshot<T>
Snapshot class for thePojoSerializer
.class
RowComparator
Comparator forRow
.class
RowSerializer
Serializer forRow
.class
RuntimeComparatorFactory<T>
class
RuntimePairComparatorFactory<T1,T2>
class
RuntimeSerializerFactory<T>
class
Tuple0Serializer
class
TupleComparator<T extends Tuple>
class
TupleComparatorBase<T>
class
TupleSerializer<T extends Tuple>
class
TupleSerializerBase<T>
class
TupleSerializerSnapshot<T extends Tuple>
Snapshot of a tuple serializer's configuration.class
ValueComparator<T extends Value & Comparable<T>>
Comparator for all Value types that extend Keyclass
ValueSerializer<T extends Value>
Serializer forValue
types.class
WritableComparator<T extends org.apache.hadoop.io.Writable & Comparable<T>>
ATypeComparator
forWritable
.class
WritableSerializer<T extends org.apache.hadoop.io.Writable>
ATypeSerializer
forWritable
.static class
WritableSerializer.WritableSerializerSnapshot<T extends org.apache.hadoop.io.Writable>
WritableSerializer
snapshot class. -
Uses of Internal in org.apache.flink.api.java.typeutils.runtime.kryo
Classes in org.apache.flink.api.java.typeutils.runtime.kryo with annotations of type Internal Modifier and Type Class Description class
Serializers
Class containing utilities for the serializers of the Flink Runtime. -
Uses of Internal in org.apache.flink.cep.functions.adaptors
Classes in org.apache.flink.cep.functions.adaptors with annotations of type Internal Modifier and Type Class Description class
PatternFlatSelectAdapter<IN,OUT>
Adapter that expressesPatternFlatSelectFunction
withPatternProcessFunction
.class
PatternSelectAdapter<IN,OUT>
Adapter that expressesPatternSelectFunction
withPatternProcessFunction
.class
PatternTimeoutFlatSelectAdapter<IN,OUT,T>
Adapter that expresses combination ofPatternFlatSelectFunction
andPatternTimeoutFlatSelectAdapter
withPatternProcessFunction
.class
PatternTimeoutSelectAdapter<IN,OUT,T>
Adapter that expresses combination ofPatternSelectFunction
andPatternTimeoutFlatSelectAdapter
withPatternProcessFunction
. -
Uses of Internal in org.apache.flink.cep.nfa.sharedbuffer
Classes in org.apache.flink.cep.nfa.sharedbuffer with annotations of type Internal Modifier and Type Class Description class
LockableTypeSerializerSnapshot<E>
-
Uses of Internal in org.apache.flink.cep.operator
Classes in org.apache.flink.cep.operator with annotations of type Internal Modifier and Type Class Description class
CepOperator<IN,KEY,OUT>
CEP pattern operator for a keyed input stream. -
Uses of Internal in org.apache.flink.cep.pattern.conditions
Classes in org.apache.flink.cep.pattern.conditions with annotations of type Internal Modifier and Type Class Description class
BooleanConditions
Utility class containing anIterativeCondition
that always returnstrue
and one that always returnsfalse
.class
RichAndCondition<T>
class
RichNotCondition<T>
Acondition
which negates the condition it wraps and returnstrue
if the original condition returnsfalse
.class
RichOrCondition<T>
Acondition
which combines two conditions with a logicalOR
and returnstrue
if at least one istrue
.class
SubtypeCondition<T>
Acondition
which filters elements of the given type. -
Uses of Internal in org.apache.flink.cep.time
Classes in org.apache.flink.cep.time with annotations of type Internal Modifier and Type Interface Description interface
TimerService
Enables to provide time characteristic toNFA
for use inIterativeCondition
. -
Uses of Internal in org.apache.flink.changelog.fs
Classes in org.apache.flink.changelog.fs with annotations of type Internal Modifier and Type Class Description class
FsStateChangelogStorageFactory
FsStateChangelogStorage
factory.interface
RetryPolicy
Retry policy to use byRetryingExecutor
.class
StateChangeFormat
Serialization format for state changes.class
StateChangeSet
A set of changes made to some state(s) by a single state backend during a single checkpoint.interface
StateChangeUploader
The purpose of this interface is to abstract the different implementations of uploading state changelog parts.interface
StateChangeUploadScheduler
Schedulesupload tasks
on aStateChangeUploader
.interface
TaskChangelogRegistry
TM-side registry ofStateObjects
, each representing one or more changelog segments.class
UploadResult
Result of uploading state changes. -
Uses of Internal in org.apache.flink.client.cli
Classes in org.apache.flink.client.cli with annotations of type Internal Modifier and Type Interface Description interface
ApplicationDeployer
An interface to be used by theCliFrontend
to submit user programs for execution.class
ExecutionConfigAccessor
Accessor that exposes config settings that are relevant for execution from an underlyingConfiguration
.class
GenericCLI
A generic implementation of theCustomCommandLine
that only expects the execution.target parameter to be explicitly specified and simply forwards the rest of the options specified with -D to the correspondingPipelineExecutor
for further parsing. -
Uses of Internal in org.apache.flink.client.deployment
Classes in org.apache.flink.client.deployment with annotations of type Internal Modifier and Type Class Description class
AbstractContainerizedClusterClientFactory<ClusterID>
An abstractClusterClientFactory
containing some common implementations for different containerized deployment clusters.interface
ClusterClientFactory<ClusterID>
A factory containing all the necessary information for creating clients to Flink clusters.class
DefaultClusterClientServiceLoader
A service provider forcluster client factories
.class
StandaloneClientFactory
AClusterClientFactory
for a standalone cluster, i.e. -
Uses of Internal in org.apache.flink.client.deployment.application
Classes in org.apache.flink.client.deployment.application with annotations of type Internal Modifier and Type Class Description class
ApplicationConfiguration
Application-specific configurations.class
ApplicationDispatcherBootstrap
ADispatcherBootstrap
used for running the user'smain()
in "Application Mode" (see FLIP-85).class
ApplicationDispatcherGatewayServiceFactory
ADispatcherGatewayServiceFactory
used when executing a job in Application Mode, i.e. the user's main is executed on the same machine as theDispatcher
and the lifecycle of the cluster is the same as the one of the application.class
ApplicationDispatcherLeaderProcessFactoryFactory
Factory for aDispatcherLeaderProcessFactoryFactory
designed to be used when executing an application in Application Mode.interface
ApplicationRunner
An interface to be implemented by the entities responsible for application submission for the different deployment environments.class
DetachedApplicationRunner
AnApplicationRunner
which runs the user specified application using theEmbeddedExecutor
.class
EmbeddedJobClient
AJobClient
with the ability to also submit jobs which uses directly theDispatcherGateway
.class
UnsuccessfulExecutionException
Exception that signals the failure of an application with a givenApplicationStatus
. -
Uses of Internal in org.apache.flink.client.deployment.application.cli
Classes in org.apache.flink.client.deployment.application.cli with annotations of type Internal Modifier and Type Class Description class
ApplicationClusterDeployer
An entity responsible for submitting an application for execution in "Application Mode", i.e. on a dedicated cluster that is created on application submission and torn down upon application termination, and with itsmain()
executed on the cluster, rather than the client. -
Uses of Internal in org.apache.flink.client.deployment.application.executors
Classes in org.apache.flink.client.deployment.application.executors with annotations of type Internal Modifier and Type Class Description class
EmbeddedExecutor
A base class forexecutors
that invoke directly methods of theDispatcher
and do not go through the REST API.class
EmbeddedExecutorFactory
AnPipelineExecutorFactory
for theEmbeddedExecutor
.class
EmbeddedExecutorServiceLoader
APipelineExecutorServiceLoader
that always returns anEmbeddedExecutorFactory
.interface
EmbeddedJobClientCreator
An interface to be implemented byJobClient
suppliers.class
WebSubmissionExecutorFactory
class
WebSubmissionExecutorServiceLoader
APipelineExecutorServiceLoader
that always returns anWebSubmissionExecutorFactory
. -
Uses of Internal in org.apache.flink.client.deployment.executors
Classes in org.apache.flink.client.deployment.executors with annotations of type Internal Modifier and Type Class Description class
AbstractJobClusterExecutor<ClusterID,ClientFactory extends ClusterClientFactory<ClusterID>>
Deprecated.class
AbstractSessionClusterExecutor<ClusterID,ClientFactory extends ClusterClientFactory<ClusterID>>
An abstractPipelineExecutor
used to executepipelines
on an existing (session) cluster.class
LocalExecutor
AnPipelineExecutor
for executing aPipeline
locally.class
LocalExecutorFactory
class
RemoteExecutor
ThePipelineExecutor
to be used when executing a job on an already running cluster.class
RemoteExecutorFactory
-
Uses of Internal in org.apache.flink.client.program
Classes in org.apache.flink.client.program with annotations of type Internal Modifier and Type Interface Description interface
ClusterClientProvider<T>
Factory forClusterClients
.class
MutatedConfigurationException
IfDeploymentOptions.PROGRAM_CONFIG_ENABLED
is disabled, configurations in the user jar will throw this exception.interface
PackagedProgramRetriever
Interface which allows to retrieve thePackagedProgram
.Constructors in org.apache.flink.client.program with annotations of type Internal Constructor Description StreamContextEnvironment(PipelineExecutorServiceLoader executorServiceLoader, Configuration clusterConfiguration, Configuration configuration, ClassLoader userCodeClassLoader, boolean enforceSingleJobExecution, boolean suppressSysout, boolean programConfigEnabled, Collection<String> programConfigWildcards)
-
Uses of Internal in org.apache.flink.configuration
Classes in org.apache.flink.configuration with annotations of type Internal Modifier and Type Class Description class
ConfigUtils
General utilities for parsing values to configuration options.class
DeploymentOptionsInternal
Internal options used during deployment.class
GlobalConfiguration
Global configuration object for Flink.class
PipelineOptionsInternal
Pipeline options that are not meant to be used by the user.static class
RestartStrategyOptions.RestartStrategyType
The restart strategy type.class
TaskManagerOptionsInternal
TaskManager options that are not meant to be used by the user.Fields in org.apache.flink.configuration with annotations of type Internal Modifier and Type Field Description static ConfigOption<Boolean>
StateRecoveryOptions. APPROXIMATE_LOCAL_RECOVERY
Access to this option is officially only supported viaorg.apache.flink.runtime.jobgraph.CheckpointConfig#enableApproximateLocalRecovery(boolean)
, but there is no good reason behind this.static ConfigOption<Boolean>
RpcOptions. FORCE_RPC_INVOCATION_SERIALIZATION
static String[]
CoreOptions. PARENT_FIRST_LOGGING_PATTERNS
static String
RestartStrategyOptions. RESTART_STRATEGY_CONFIG_PREFIX
Methods in org.apache.flink.configuration with annotations of type Internal Modifier and Type Method Description byte[]
Configuration. getBytes(String key, byte[] defaultValue)
Returns the value associated with the given key as a byte array.InlineElement
ExternalizedCheckpointRetention. getDescription()
InlineElement
JobManagerOptions.SchedulerType. getDescription()
static String[]
CoreOptions. mergeListsToArray(List<String> base, List<String> append)
void
Configuration. setBytes(String key, byte[] bytes)
Adds the given byte array to the configuration object.Map<String,String>
Configuration. toFileWritableMap()
Convert Config into aMap<String, String>
representation.Map<String,String>
ReadableConfig. toMap()
Converts the configuration items into a map of string key-value pairs. -
Uses of Internal in org.apache.flink.connector.base.sink.throwable
Classes in org.apache.flink.connector.base.sink.throwable with annotations of type Internal Modifier and Type Class Description class
FatalExceptionClassifier
Classifier class for retryable exceptions on request submission failure. -
Uses of Internal in org.apache.flink.connector.base.sink.writer
Classes in org.apache.flink.connector.base.sink.writer with annotations of type Internal Modifier and Type Class Description class
AsyncSinkFatalExceptionClassifiers
Common retry exception classifiers needed for common errors. -
Uses of Internal in org.apache.flink.connector.base.sink.writer.strategy
Classes in org.apache.flink.connector.base.sink.writer.strategy with annotations of type Internal Modifier and Type Class Description class
BasicRequestInfo
Dataclass to encapsulate information about starting requests.class
BasicResultInfo
Dataclass to encapsulate results from completed requests. -
Uses of Internal in org.apache.flink.connector.base.source.hybrid
Methods in org.apache.flink.connector.base.source.hybrid with annotations of type Internal Modifier and Type Method Description SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState>
HybridSource. createEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext)
SourceReader<T,HybridSourceSplit>
HybridSource. createReader(SourceReaderContext readerContext)
SimpleVersionedSerializer<HybridSourceEnumeratorState>
HybridSource. getEnumeratorCheckpointSerializer()
SimpleVersionedSerializer<HybridSourceSplit>
HybridSource. getSplitSerializer()
SplitEnumerator<HybridSourceSplit,HybridSourceEnumeratorState>
HybridSource. restoreEnumerator(SplitEnumeratorContext<HybridSourceSplit> enumContext, HybridSourceEnumeratorState checkpoint)
-
Uses of Internal in org.apache.flink.connector.base.source.reader.fetcher
Classes in org.apache.flink.connector.base.source.reader.fetcher with annotations of type Internal Modifier and Type Class Description class
RemoveSplitsTask<SplitT extends SourceSplit>
The task to finish reading some splits.Methods in org.apache.flink.connector.base.source.reader.fetcher with annotations of type Internal Modifier and Type Method Description FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>
SplitFetcherManager. getQueue()
Return the queue contains data produced by split fetchers.This method is Internal and only used inSourceReaderBase
. -
Uses of Internal in org.apache.flink.connector.base.source.reader.splitreader
Classes in org.apache.flink.connector.base.source.reader.splitreader with annotations of type Internal Modifier and Type Class Description class
SplitsRemoval<SplitT>
A change to remove splits. -
Uses of Internal in org.apache.flink.connector.base.source.reader.synchronization
Classes in org.apache.flink.connector.base.source.reader.synchronization with annotations of type Internal Modifier and Type Class Description class
FutureCompletingBlockingQueue<T>
A custom implementation of blocking queue in combination with aCompletableFuture
that is used in the hand-over of data from a producing thread to a consuming thread. -
Uses of Internal in org.apache.flink.connector.base.source.utils
Classes in org.apache.flink.connector.base.source.utils with annotations of type Internal Modifier and Type Class Description class
SerdeUtils
A util class with some helper method for serde in the sources. -
Uses of Internal in org.apache.flink.connector.base.table
Classes in org.apache.flink.connector.base.table with annotations of type Internal Modifier and Type Class Description class
AsyncDynamicTableSinkFactory.AsyncDynamicSinkContext
Class providing common table data required byAsyncDynamicTableSinkFactory
to createAsyncDynamicTableSink
. -
Uses of Internal in org.apache.flink.connector.blackhole.table
Classes in org.apache.flink.connector.blackhole.table with annotations of type Internal Modifier and Type Class Description class
BlackHoleTableSinkFactory
Black hole table sink factory swallowing all input records. -
Uses of Internal in org.apache.flink.connector.datagen.functions
Classes in org.apache.flink.connector.datagen.functions with annotations of type Internal Modifier and Type Class Description class
FromElementsGeneratorFunction<OUT>
A stream generator function that returns a sequence of elements.class
IndexLookupGeneratorFunction<OUT>
A stream generator function that returns elements from the collection based on their index. -
Uses of Internal in org.apache.flink.connector.datagen.table
Classes in org.apache.flink.connector.datagen.table with annotations of type Internal Modifier and Type Class Description class
DataGenConnectorOptionsUtil
Utilities forDataGenConnectorOptions
.class
DataGeneratorContainer
Container class for wrapping awith its configuration options
.class
DataGenTableSource
AStreamTableSource
that emits generated data rows.class
DataGenTableSourceFactory
Factory for creating configured instances ofDataGenTableSource
in a stream environment.class
DataGenVisitorBase
Base class for translatingLogicalTypes
toDataGeneratorContainer
's.class
RandomGeneratorVisitor
Creates a randomDataGeneratorContainer
for a particular logical type.class
SequenceGeneratorVisitor
Creates a sequentialDataGeneratorContainer
for a particular logical type. -
Uses of Internal in org.apache.flink.connector.datagen.table.types
Classes in org.apache.flink.connector.datagen.table.types with annotations of type Internal Modifier and Type Class Description class
DataGeneratorMapper<A,B>
Utility for mapping the output of aDataGenerator
.class
DecimalDataRandomGenerator
Generates randomDecimalData
values.class
RowDataGenerator
Data generator for Flink's internalRowData
type. -
Uses of Internal in org.apache.flink.connector.file.sink
Classes in org.apache.flink.connector.file.sink with annotations of type Internal Modifier and Type Class Description class
FileSinkCommittable
Wrapper class for both type of committables inFileSink
.class
FileSinkCommittableSerializer
Versioned serializer forFileSinkCommittable
. -
Uses of Internal in org.apache.flink.connector.file.sink.committer
Classes in org.apache.flink.connector.file.sink.committer with annotations of type Internal Modifier and Type Class Description class
FileCommitter
Committer implementation forFileSink
. -
Uses of Internal in org.apache.flink.connector.file.sink.compactor
Classes in org.apache.flink.connector.file.sink.compactor with annotations of type Internal Modifier and Type Class Description class
IdenticalFileCompactor
A simpleOutputStreamBasedFileCompactor
implementation that directly copy the content of the only input file to the output. -
Uses of Internal in org.apache.flink.connector.file.sink.compactor.operator
Classes in org.apache.flink.connector.file.sink.compactor.operator with annotations of type Internal Modifier and Type Class Description class
CompactCoordinator
Coordinator that coordinates file compaction for theFileSink
.class
CompactCoordinatorFactory
Factory forCompactCoordinator
.class
CompactCoordinatorStateHandlerFactory
Factory forCompactCoordinatorStateHandler
.class
CompactorOperator
An operator that perform compaction for theFileSink
.class
CompactorOperatorFactory
Factory forCompactorOperator
.class
CompactorOperatorStateHandler
Handler that processes the state ofCompactorOperator
when compaction is disabled.class
CompactorOperatorStateHandlerFactory
Factory forCompactorOperatorStateHandler
.class
CompactorRequest
Request of file compacting forFileSink
.class
CompactorRequestSerializer
Versioned serializer forCompactorRequest
.class
CompactorRequestTypeInfo
Type information ofCompactorRequest
.class
CompactService
The asynchronous file compaction service. -
Uses of Internal in org.apache.flink.connector.file.sink.writer
Classes in org.apache.flink.connector.file.sink.writer with annotations of type Internal Modifier and Type Class Description class
DefaultFileWriterBucketFactory<IN>
A factory returningwriter
.class
FileWriter<IN>
ASinkWriter
implementation forFileSink
.interface
FileWriterBucketFactory<IN>
A factory able to createFileWriterBucket
for theFileSink
.class
FileWriterBucketState
States forFileWriterBucket
.class
FileWriterBucketStateSerializer
ASimpleVersionedSerializer
used to serialize theBucketState
. -
Uses of Internal in org.apache.flink.connector.file.src
Classes in org.apache.flink.connector.file.src with annotations of type Internal Modifier and Type Class Description class
ContinuousEnumerationSettings
Settings describing how to do continuous file discovery and enumeration for the file source's continuous discovery and streaming mode. -
Uses of Internal in org.apache.flink.connector.file.src.enumerate
Classes in org.apache.flink.connector.file.src.enumerate with annotations of type Internal Modifier and Type Class Description class
BlockSplittingRecursiveAllDirEnumerator
ThisFileEnumerator
enumerates all files under the given paths recursively except the hidden directories, and creates a separate split for each file block.class
NonSplittingRecursiveAllDirEnumerator
ThisFileEnumerator
enumerates all files under the given paths recursively except the hidden directories. -
Uses of Internal in org.apache.flink.connector.file.src.impl
Classes in org.apache.flink.connector.file.src.impl with annotations of type Internal Modifier and Type Class Description class
ContinuousFileSplitEnumerator
A continuously monitoring enumerator.class
DynamicFileSplitEnumerator<SplitT extends FileSourceSplit>
A SplitEnumerator implementation that supports dynamic filtering.class
FileRecords<T>
A collection of records for one file split.class
FileSourceReader<T,SplitT extends FileSourceSplit>
ASourceReader
that read records fromFileSourceSplit
.class
StaticFileSplitEnumerator
A SplitEnumerator implementation for bounded / batchFileSource
input.class
StreamFormatAdapter<T>
Adapter to turn aStreamFormat
into aBulkFormat
. -
Uses of Internal in org.apache.flink.connector.file.src.util
Classes in org.apache.flink.connector.file.src.util with annotations of type Internal Modifier and Type Class Description class
RecyclableIterator<E>
Utility base class for iterators that accept a recycler. -
Uses of Internal in org.apache.flink.connector.file.table
Classes in org.apache.flink.connector.file.table with annotations of type Internal Modifier and Type Class Description class
BinPacking
A bin packing implementation.class
ColumnarRowIterator
ABulkFormat.RecordIterator
that returnsRowData
s.interface
ContinuousPartitionFetcher<P,T extends Comparable<T>>
Partition fetcher for helping continuously fetch partitioned table.class
DefaultPartTimeExtractor
DefaultPartitionTimeExtractor
.class
DeserializationSchemaAdapter
Adapter to turn aDeserializationSchema
into aBulkFormat
.class
DynamicPartitionWriter<T>
Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.class
EmptyMetaStoreFactory
Empty implementationTableMetaStoreFactory
.class
EnrichedRowData
class
FileSystemCommitter
File system file committer implementation.interface
FileSystemFactory
A factory to create file systems.class
FileSystemOutputFormat<T>
File systemOutputFormat
for batch job.class
FileSystemTableFactory
File systemTableFactory
.class
FileSystemTableSink
File systemDynamicTableSink
.class
FileSystemTableSource
File system table source.class
GroupedPartitionWriter<T>
PartitionWriter
for grouped dynamic partition inserting.class
LimitableBulkFormat<T,SplitT extends FileSourceSplit>
ABulkFormat
that can limit output record number.class
MetastoreCommitPolicy
Partition commit policy to update metastore.interface
OutputFormatFactory<T>
A factory to create anOutputFormat
.class
PartitionCommitPolicyFactory
A factory to createPartitionCommitPolicy
chain.interface
PartitionComputer<T>
Compute partition path from record and project non-partition columns for output writer.interface
PartitionFetcher<P>
Fetcher to fetch the suitable partitions of a filesystem table.interface
PartitionFieldExtractor<T extends FileSourceSplit>
Interface to extract partition field from split.class
PartitionLoader
Loader to temporary files to final output path and meta store.interface
PartitionReader<P,OUT>
Reader that reads record from given partitions.class
PartitionTempFileManager
Manage temporary files for writing files.interface
PartitionWriter<T>
Partition writer to write records with partition.interface
PartitionWriterFactory<T>
Factory ofPartitionWriter
to avoid virtual function calls.class
RowDataPartitionComputer
PartitionComputer
forRowData
.class
RowPartitionComputer
PartitionComputer
forRow
.class
SerializationSchemaAdapter
Adapter to turn aSerializationSchema
into aEncoder
.class
SingleDirectoryWriter<T>
PartitionWriter
for single directory writer.class
SuccessFileCommitPolicy
Partition commit policy to add success file to directory.interface
TableMetaStoreFactory
Meta store factory to createTableMetaStoreFactory.TableMetaStore
. -
Uses of Internal in org.apache.flink.connector.file.table.batch
Classes in org.apache.flink.connector.file.table.batch with annotations of type Internal Modifier and Type Class Description class
BatchSink
Helper for creating batch file sink. -
Uses of Internal in org.apache.flink.connector.file.table.factories
Classes in org.apache.flink.connector.file.table.factories with annotations of type Internal Modifier and Type Interface Description interface
BulkReaderFormatFactory
Base interface for configuring aBulkFormat
for file system connector.interface
BulkWriterFormatFactory
Base interface for configuring aBulkWriter.Factory
for file system connector. -
Uses of Internal in org.apache.flink.connector.file.table.format
Classes in org.apache.flink.connector.file.table.format with annotations of type Internal Modifier and Type Interface Description interface
BulkDecodingFormat<T>
-
Uses of Internal in org.apache.flink.connector.file.table.stream
Classes in org.apache.flink.connector.file.table.stream with annotations of type Internal Modifier and Type Class Description class
PartitionCommitInfo
The message sent by upstream.interface
PartitionCommitPredicate
Partition commit predicate.class
PartitionCommitter
Committer operator for partitions.interface
PartitionCommitTrigger
Partition commit trigger.class
PartitionTimeCommitPredicate
Partition commit predicate by partition time and watermark, if 'watermark' > 'partition-time' + 'delay', the partition is committable.class
PartitionTimeCommitTrigger
Partition commit trigger by partition time and watermark.class
ProcTimeCommitPredicate
Partition commit trigger by creation time and processing time service, if 'current processing time' > 'partition creation time' + 'delay', the partition is committable.class
ProcTimeCommitTrigger
Partition commit trigger by creation time and processing time service.class
StreamingFileWriter<IN>
Writer for emittingPartitionCommitInfo
to downstream.class
StreamingSink
Helper for creating streaming file sink.class
TaskTracker
Track the upstream tasks to determine whether all the upstream data of a checkpoint has been received. -
Uses of Internal in org.apache.flink.connector.file.table.stream.compact
Classes in org.apache.flink.connector.file.table.stream.compact with annotations of type Internal Modifier and Type Class Description class
CompactBucketWriter<T>
TheCompactWriter
to delegateBucketWriter
.class
CompactBulkReader<T>
TheCompactReader
to delegateCompactBulkReader
.interface
CompactContext
Context forCompactReader
andCompactWriter
.class
CompactCoordinator
This is the single (non-parallel) monitoring task which coordinate input files to compaction units. - Receives in-flight input files inside checkpoint. - Receives all upstream end input messages after the checkpoint completes successfully, starts coordination.class
CompactFileWriter<T>
Writer for emittingCompactMessages.InputFile
andCompactMessages.EndCheckpoint
to downstream.class
CompactMessages
Util class for all compaction messages.class
CompactOperator<T>
Receives compaction units to do compaction.interface
CompactReader<T>
Reader for compaction.interface
CompactWriter<T>
Writer for compaction.class
FileInputFormatCompactReader<T>
TheCompactReader
to delegateFileInputFormat
. -
Uses of Internal in org.apache.flink.connector.print.table
Classes in org.apache.flink.connector.print.table with annotations of type Internal Modifier and Type Class Description class
PrintTableSinkFactory
Print table sink factory writing every row to the standard output or standard error stream. -
Uses of Internal in org.apache.flink.connector.testframe.junit.extensions
Classes in org.apache.flink.connector.testframe.junit.extensions with annotations of type Internal Modifier and Type Class Description class
ConnectorTestingExtension
A JUnit 5Extension
for supporting running of connector testing framework.class
TestCaseInvocationContextProvider
A helper class for injecting test resources into test case as parameters. -
Uses of Internal in org.apache.flink.connector.upserttest.sink
Classes in org.apache.flink.connector.upserttest.sink with annotations of type Internal Modifier and Type Class Description class
UpsertTestFileUtil
Collection uf utility methods for reading and writing files from theUpsertTestSink
.Methods in org.apache.flink.connector.upserttest.sink with annotations of type Internal Modifier and Type Method Description SinkWriter<IN>
UpsertTestSink. createWriter(WriterInitContext context)
-
Uses of Internal in org.apache.flink.connector.upserttest.table
Classes in org.apache.flink.connector.upserttest.table with annotations of type Internal Modifier and Type Class Description class
UpsertTestDynamicTableSinkFactory
ADynamicTableSinkFactory
for discoveringUpsertTestDynamicTableSink
. -
Uses of Internal in org.apache.flink.container.entrypoint
Classes in org.apache.flink.container.entrypoint with annotations of type Internal Modifier and Type Class Description class
StandaloneApplicationClusterEntryPoint
AnApplicationClusterEntryPoint
which is started with a job in a predefined location. -
Uses of Internal in org.apache.flink.core.execution
Classes in org.apache.flink.core.execution with annotations of type Internal Modifier and Type Interface Description interface
CacheSupportedPipelineExecutor
The pipeline executor that support caching intermediate dataset.class
DefaultExecutorServiceLoader
The default implementation of thePipelineExecutorServiceLoader
.class
DefaultJobExecutionStatusEvent
Default implementation forJobExecutionStatusEvent
.class
DetachedJobExecutionResult
TheJobExecutionResult
returned by a context environment when executing a job in detached mode.class
JobStatusChangedListenerUtils
Util class forJobStatusChangedListener
.interface
JobStatusHook
Hooks on job status changing.interface
PipelineExecutor
The entity responsible for executing aPipeline
, i.e. a user job.interface
PipelineExecutorFactory
A factory for selecting and instantiating the adequatePipelineExecutor
based on a providedConfiguration
.interface
PipelineExecutorServiceLoader
An interface to be implemented by the entity responsible for finding the correctPipelineExecutor
to execute a givenPipeline
.Methods in org.apache.flink.core.execution with annotations of type Internal Modifier and Type Method Description InlineElement
RecoveryClaimMode. getDescription()
InlineElement
SavepointFormatType. getDescription()
-
Uses of Internal in org.apache.flink.core.fs
Classes in org.apache.flink.core.fs with annotations of type Internal Modifier and Type Class Description class
AutoCloseableRegistry
This class allows to register instances ofAutoCloseable
, which are all closed if this registry is closed.class
BackPressuringExecutor
An executor decorator that allows only a certain number of concurrent executions.class
ByteBufferReadableClosingFSDataInputStream
AClosingFSDataInputStream
which isByteBufferReadable
.class
CloseableRegistry
ICloseableRegistry
implementation.class
ClosingFSDataInputStream
This class is aWrappingProxy
forFSDataInputStream
that is used to implement a safety net against unclosed streams.class
ClosingFSDataOutputStream
This class is aWrappingProxy
forFSDataOutputStream
that is used to implement a safety net against unclosed streams.class
ConnectionLimitingFactory
A wrapping factory that adds aLimitedConnectionsFileSystem
to a file system.static class
FileSystem.FSKey
An identifier of a file system, via its scheme and its authority.class
FileSystemSafetyNet
The FileSystemSafetyNet can be used to guard a thread againstFileSystem
stream resource leaks.class
FSDataInputStreamWrapper
Simple forwarding wrapper aroundFSDataInputStream
.class
FSDataOutputStreamWrapper
Simple forwarding wrapper aroundFSDataInputStream
.interface
ICloseableRegistry
This class allows to register instances ofCloseable
, which are all closed if this registry is closed.class
LimitedConnectionsFileSystem
A file system that limits the number of concurrently open input streams, output streams, and total streams for a target file system.class
OffsetAwareOutputStream
AnOutputStream
that keeps track of its current length.class
RefCountedBufferingFileStream
ARefCountedFileWithStream
that also uses an in-memory buffer for buffering small writes.class
RefCountedFile
A reference counted file which is deleted as soon as no caller holds a reference to the wrappedFile
.class
RefCountedFileWithStream
A reference counted file which is deleted as soon as no caller holds a reference to the wrappedFile
.class
RefCountedFSOutputStream
AFSDataOutputStream
with theRefCounted
functionality.class
RefCountedTmpFileCreator
A utility class that creates localreference counted files
that serve as temporary files.class
SafetyNetCloseableRegistry
This implementation of anAbstractAutoCloseableRegistry
registersWrappingProxyCloseable
.class
SafetyNetWrapperFileSystem
This is aWrappingProxy
aroundFileSystem
which (i) wraps all opened streams asClosingFSDataInputStream
orClosingFSDataOutputStream
and (ii) registers them to aSafetyNetCloseableRegistry
.interface
WrappingProxyCloseable<T extends Closeable>
WrappingProxy
forCloseable
that is also closeable.Methods in org.apache.flink.core.fs with annotations of type Internal Modifier and Type Method Description static void
FileSystemSafetyNet. closeSafetyNetAndGuardedResourcesForThread()
Closes the safety net for a thread.static FileSystem
FileSystem. getUnguardedFileSystem(URI fsUri)
static void
FileSystemSafetyNet. initializeSafetyNetForThread()
Activates the safety net for a thread. -
Uses of Internal in org.apache.flink.core.fs.local
Classes in org.apache.flink.core.fs.local with annotations of type Internal Modifier and Type Class Description class
LocalBlockLocation
Implementation of theBlockLocation
interface for a local file system.class
LocalDataInputStream
TheLocalDataInputStream
class is a wrapper class for a data input stream to the local file system.class
LocalDataOutputStream
TheLocalDataOutputStream
class is a wrapper class for a data output stream to the local file system.class
LocalFileStatus
The classLocalFileStatus
provides an implementation of theFileStatus
interface for the local file system.class
LocalFileSystem
The classLocalFileSystem
is an implementation of theFileSystem
interface for the local file system of the machine where the JVM runs.class
LocalRecoverableFsDataOutputStream
ARecoverableFsDataOutputStream
for theLocalFileSystem
.class
LocalRecoverableWriter
ARecoverableWriter
for theLocalFileSystem
. -
Uses of Internal in org.apache.flink.core.io
Classes in org.apache.flink.core.io with annotations of type Internal Modifier and Type Class Description class
PostVersionedIOReadableWritable
AVersionedIOReadableWritable
which allows to differentiate whether the previous data was versioned with aVersionedIOReadableWritable
.class
SimpleVersionedSerializerAdapter<T>
Adapter forTypeSerializer
toSimpleVersionedSerializer
.class
SimpleVersionedSerializerTypeSerializerProxy<T>
ATypeSerializer
that delegates to an underlyingSimpleVersionedSerializer
.class
VersionedIOReadableWritable
This is the abstract base class forIOReadableWritable
which allows to differentiate between serialization versions. -
Uses of Internal in org.apache.flink.core.memory
Classes in org.apache.flink.core.memory with annotations of type Internal Modifier and Type Class Description class
ByteArrayInputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayInputStream that also exposes the current position.class
ByteArrayOutputStreamWithPos
Un-synchronized stream similar to Java's ByteArrayOutputStream that also exposes the current position.class
ManagedMemoryUseCase
Use cases of managed memory.class
MemorySegment
This class represents a piece of memory managed by Flink.class
MemorySegmentFactory
A factory for memory segments (MemorySegment
).interface
MemorySegmentSource
Interface describing entities that can provide memory segments.interface
MemorySegmentWritable
Provides the interface for write(Segment).class
MemoryUtils
Utility class for memory operations. -
Uses of Internal in org.apache.flink.core.plugin
Classes in org.apache.flink.core.plugin with annotations of type Internal Modifier and Type Class Description class
DefaultPluginManager
Default implementation ofPluginManager
. -
Uses of Internal in org.apache.flink.core.state
Classes in org.apache.flink.core.state with annotations of type Internal Modifier and Type Class Description class
CompletedStateFuture<T>
AStateFuture
that has already been completed when it is created.interface
InternalStateFuture<T>
The Internal definition ofStateFuture
, add some method that will be used by framework.class
StateFutureImpl<T>
The default implementation ofStateFuture
. -
Uses of Internal in org.apache.flink.formats.avro
Classes in org.apache.flink.formats.avro with annotations of type Internal Modifier and Type Class Description class
AbstractAvroBulkFormat<A,T,SplitT extends FileSourceSplit>
Provides aBulkFormat
for Avro records.class
AvroFileFormatFactory
Avro format factory for file system.class
AvroFormatFactory
Table format factory for providing configured instances of Avro to RowDataSerializationSchema
andDeserializationSchema
.class
AvroRowDeserializationSchema
Deserialization schema from Avro bytes toRow
.class
AvroRowSerializationSchema
Serialization schema that serializesRow
into Avro bytes.class
AvroToRowDataConverters
Tool class used to convert from AvroGenericRecord
toRowData
.class
RowDataToAvroConverters
Tool class used to convert fromRowData
to AvroGenericRecord
. -
Uses of Internal in org.apache.flink.formats.avro.registry.confluent
Classes in org.apache.flink.formats.avro.registry.confluent with annotations of type Internal Modifier and Type Class Description class
RegistryAvroFormatFactory
Table format factory for providing configured instances of Schema Registry Avro to RowDataSerializationSchema
andDeserializationSchema
. -
Uses of Internal in org.apache.flink.formats.avro.registry.confluent.debezium
Classes in org.apache.flink.formats.avro.registry.confluent.debezium with annotations of type Internal Modifier and Type Class Description class
DebeziumAvroDeserializationSchema
Deserialization schema from Debezium Avro to Flink Table/SQL internal data structureRowData
.class
DebeziumAvroFormatFactory
Format factory for providing configured instances of Debezium Avro to RowDataDeserializationSchema
.class
DebeziumAvroSerializationSchema
Serialization schema from Flink Table/SQL internal data structureRowData
to Debezium Avro. -
Uses of Internal in org.apache.flink.formats.avro.typeutils
Classes in org.apache.flink.formats.avro.typeutils with annotations of type Internal Modifier and Type Class Description class
AvroFactory<T>
Creates AvroDatumReader
andDatumWriter
. -
Uses of Internal in org.apache.flink.formats.common
Classes in org.apache.flink.formats.common with annotations of type Internal Modifier and Type Class Description class
TimeFormats
Time formats and timestamp formats respecting the RFC3339 specification, ISO-8601 specification and SQL specification.class
TimestampFormat
Timestamp format Enums. -
Uses of Internal in org.apache.flink.formats.csv
Classes in org.apache.flink.formats.csv with annotations of type Internal Modifier and Type Class Description class
CsvFileFormatFactory
CSV format factory for file system.class
CsvFormatFactory
Format factory for providing configured instances of CSV to RowDataSerializationSchema
andDeserializationSchema
.class
CsvRowDataDeserializationSchema
Deserialization schema from CSV to Flink Table & SQL internal data structures.static class
CsvRowDataDeserializationSchema.Builder
A builder for creating aCsvRowDataDeserializationSchema
.class
CsvRowDeserializationSchema
Deserialization schema from CSV to Flink types.class
CsvRowSerializationSchema
Serialization schema that serializes an object of Flink types into a CSV bytes.class
CsvToRowDataConverters
Tool class used to convert from CSV-formatJsonNode
toRowData
.class
RowDataToCsvConverters
Tool class used to convert fromRowData
to CSV-formatJsonNode
. -
Uses of Internal in org.apache.flink.formats.hadoop.bulk
Classes in org.apache.flink.formats.hadoop.bulk with annotations of type Internal Modifier and Type Interface Description interface
HadoopFileCommitter
The committer publishes an intermediate Hadoop file to the target path after it finishes writing.interface
HadoopFileCommitterFactory
The factory to create theHadoopFileCommitter
.interface
HadoopPathBasedBulkWriter<T>
SpecializedBulkWriter
which is expected to write to specifiedPath
. -
Uses of Internal in org.apache.flink.formats.json
Classes in org.apache.flink.formats.json with annotations of type Internal Modifier and Type Class Description class
JsonFormatFactory
Table format factory for providing configured instances of JSON to RowDataSerializationSchema
andDeserializationSchema
.class
JsonFormatOptionsUtil
Utilities forJsonFormatOptions
.class
JsonParserRowDataDeserializationSchema
Tool class used to convert fields fromJsonParser
toRowData
which has a higher parsing efficiency.class
JsonParserToRowDataConverters
Tool class used to convert fields fromJsonParser
toRowData
.class
JsonRowDataDeserializationSchema
Deserialization schema from JSON to Flink Table/SQL internal data structureRowData
.class
JsonRowDataSerializationSchema
Serialization schema that serializes an object of Flink internal data structure into a JSON bytes.class
JsonRowDeserializationSchema
Deserialization schema from JSON to Flink types.class
JsonRowSerializationSchema
Serialization schema that serializes an object of Flink types into a JSON bytes.class
JsonToRowDataConverters
Tool class used to convert fromJsonNode
toRowData
.class
RowDataToJsonConverters
Tool class used to convert fromRowData
toJsonNode
. -
Uses of Internal in org.apache.flink.formats.json.canal
Classes in org.apache.flink.formats.json.canal with annotations of type Internal Modifier and Type Class Description static class
CanalJsonDeserializationSchema.Builder
A builder for creating aCanalJsonDeserializationSchema
.class
CanalJsonFormatFactory
Format factory for providing configured instances of Canal JSON to RowDataDeserializationSchema
. -
Uses of Internal in org.apache.flink.formats.json.debezium
Classes in org.apache.flink.formats.json.debezium with annotations of type Internal Modifier and Type Class Description class
DebeziumJsonDeserializationSchema
Deserialization schema from Debezium JSON to Flink Table/SQL internal data structureRowData
.class
DebeziumJsonFormatFactory
Format factory for providing configured instances of Debezium JSON to RowDataDeserializationSchema
. -
Uses of Internal in org.apache.flink.formats.json.maxwell
Classes in org.apache.flink.formats.json.maxwell with annotations of type Internal Modifier and Type Class Description class
MaxwellJsonFormatFactory
Format factory for providing configured instances of Maxwell JSON to RowDataDeserializationSchema
. -
Uses of Internal in org.apache.flink.formats.json.ogg
Classes in org.apache.flink.formats.json.ogg with annotations of type Internal Modifier and Type Class Description class
OggJsonDeserializationSchema
Deserialization schema from Ogg JSON to Flink Table/SQL internal data structureRowData
.class
OggJsonFormatFactory
Format factory for providing configured instances of Ogg JSON to RowDataDeserializationSchema
. -
Uses of Internal in org.apache.flink.formats.parquet.vector
Classes in org.apache.flink.formats.parquet.vector with annotations of type Internal Modifier and Type Class Description class
ParquetDecimalVector
Parquet write decimal as int32 and int64 and binary, this class wrap the real vector to provideDecimalColumnVector
interface. -
Uses of Internal in org.apache.flink.formats.protobuf
Classes in org.apache.flink.formats.protobuf with annotations of type Internal Modifier and Type Class Description class
PbFileFormatFactory
Throw aValidationException
when using Protobuf format factory for file system. -
Uses of Internal in org.apache.flink.formats.raw
Classes in org.apache.flink.formats.raw with annotations of type Internal Modifier and Type Class Description class
RawFormatDeserializationSchema
Deserialization schema from raw (byte based) value to Flink Table/SQL internal data structureRowData
.class
RawFormatFactory
Format factory for raw format which allows to read and write raw (byte based) values as a single column.class
RawFormatSerializationSchema
Serialization schema that serializes anRowData
object into raw (byte based) value. -
Uses of Internal in org.apache.flink.fs.azurefs
Classes in org.apache.flink.fs.azurefs with annotations of type Internal Modifier and Type Class Description class
AzureBlobFsRecoverableDataOutputStream
An implementation of theRecoverableFsDataOutputStream
for AzureBlob's file system abstraction. -
Uses of Internal in org.apache.flink.fs.osshadoop.writer
Classes in org.apache.flink.fs.osshadoop.writer with annotations of type Internal Modifier and Type Class Description class
OSSRecoverableSerializer
Serializer implementation for aOSSRecoverable
. -
Uses of Internal in org.apache.flink.fs.s3.common.token
Classes in org.apache.flink.fs.s3.common.token with annotations of type Internal Modifier and Type Class Description class
AbstractS3DelegationTokenProvider
Delegation token provider for S3 filesystems.class
AbstractS3DelegationTokenReceiver
Delegation token receiver for S3 filesystems.class
DynamicTemporaryAWSCredentialsProvider
Support dynamic session credentials for authenticating with AWS. -
Uses of Internal in org.apache.flink.fs.s3.common.writer
Classes in org.apache.flink.fs.s3.common.writer with annotations of type Internal Modifier and Type Interface Description interface
S3AccessHelper
An interface that abstracts away the Multi-Part Upload (MPU) functionality offered by S3, from the specific implementation of the file system. -
Uses of Internal in org.apache.flink.fs.s3hadoop.token
Classes in org.apache.flink.fs.s3hadoop.token with annotations of type Internal Modifier and Type Class Description class
S3HadoopDelegationTokenProvider
Delegation token provider for S3 Hadoop filesystems.class
S3HadoopDelegationTokenReceiver
Delegation token receiver for S3 Hadoop filesystems. -
Uses of Internal in org.apache.flink.fs.s3presto.token
Classes in org.apache.flink.fs.s3presto.token with annotations of type Internal Modifier and Type Class Description class
S3PrestoDelegationTokenProvider
Delegation token provider for S3 Presto filesystems.class
S3PrestoDelegationTokenReceiver
Delegation token receiver for S3 Presto filesystems. -
Uses of Internal in org.apache.flink.kubernetes
Classes in org.apache.flink.kubernetes with annotations of type Internal Modifier and Type Class Description class
KubernetesClusterClientFactory
AClusterClientFactory
for a Kubernetes cluster. -
Uses of Internal in org.apache.flink.kubernetes.artifact
Classes in org.apache.flink.kubernetes.artifact with annotations of type Internal Modifier and Type Interface Description interface
KubernetesArtifactUploader
Local artifact uploader for Kubernetes programs. -
Uses of Internal in org.apache.flink.kubernetes.cli
Classes in org.apache.flink.kubernetes.cli with annotations of type Internal Modifier and Type Class Description class
KubernetesSessionCli
Kubernetes customized commandline. -
Uses of Internal in org.apache.flink.kubernetes.configuration
Classes in org.apache.flink.kubernetes.configuration with annotations of type Internal Modifier and Type Class Description class
KubernetesConfigOptionsInternal
Kubernetes configuration options that are not meant to be set by the user.class
KubernetesDeploymentTarget
A class containing all the supported deployment target names for Kubernetes. -
Uses of Internal in org.apache.flink.kubernetes.entrypoint
Classes in org.apache.flink.kubernetes.entrypoint with annotations of type Internal Modifier and Type Class Description class
KubernetesApplicationClusterEntrypoint
AnApplicationClusterEntryPoint
for Kubernetes. -
Uses of Internal in org.apache.flink.kubernetes.executors
Classes in org.apache.flink.kubernetes.executors with annotations of type Internal Modifier and Type Class Description class
KubernetesSessionClusterExecutor
ThePipelineExecutor
to be used when executing a job on an already running cluster.class
KubernetesSessionClusterExecutorFactory
AnPipelineExecutorFactory
for executing jobs on an existing (session) cluster. -
Uses of Internal in org.apache.flink.legacy.table.connector.source
Classes in org.apache.flink.legacy.table.connector.source with annotations of type Internal Modifier and Type Interface Description interface
SourceFunctionProvider
Deprecated.This interface is based on theSourceFunction
API, which is due to be removed. -
Uses of Internal in org.apache.flink.legacy.table.descriptors
Classes in org.apache.flink.legacy.table.descriptors with annotations of type Internal Modifier and Type Class Description class
RowtimeValidator
Deprecated.SeeRowtime
for details.class
SchemaValidator
Deprecated.SeeSchema
for details. -
Uses of Internal in org.apache.flink.legacy.table.factories
Classes in org.apache.flink.legacy.table.factories with annotations of type Internal Modifier and Type Interface Description interface
StreamTableSinkFactory<T>
Deprecated.This interface has been replaced byDynamicTableSinkFactory
.interface
StreamTableSourceFactory<T>
Deprecated.This interface has been replaced byDynamicTableSourceFactory
. -
Uses of Internal in org.apache.flink.legacy.table.sinks
Classes in org.apache.flink.legacy.table.sinks with annotations of type Internal Modifier and Type Interface Description interface
AppendStreamTableSink<T>
Deprecated.This interface has been replaced byDynamicTableSink
.class
OutputFormatTableSink<T>
Deprecated.This interface has been replaced byDynamicTableSink
.interface
RetractStreamTableSink<T>
Deprecated.This interface has been replaced byDynamicTableSink
.interface
StreamTableSink<T>
Deprecated.This interface has been replaced byDynamicTableSink
.interface
UpsertStreamTableSink<T>
Deprecated.This interface has been replaced byDynamicTableSink
. -
Uses of Internal in org.apache.flink.legacy.table.sources
Classes in org.apache.flink.legacy.table.sources with annotations of type Internal Modifier and Type Class Description class
InputFormatTableSource<T>
Deprecated.This interface has been replaced byDynamicTableSource
.interface
StreamTableSource<T>
Deprecated.This interface has been replaced byDynamicTableSource
. -
Uses of Internal in org.apache.flink.metrics
Classes in org.apache.flink.metrics with annotations of type Internal Modifier and Type Class Description class
MeterView
A MeterView provides an average rate of events per second over a given time period.class
SimpleCounter
A simple low-overheadCounter
that is not thread-safe.class
ThreadSafeSimpleCounter
A simple low-overheadCounter
that is thread-safe. -
Uses of Internal in org.apache.flink.metrics.groups
Classes in org.apache.flink.metrics.groups with annotations of type Internal Modifier and Type Class Description class
UnregisteredMetricsGroup
A specialMetricGroup
that does not register any metrics at the metrics registry and any reporters. -
Uses of Internal in org.apache.flink.metrics.otel
Methods in org.apache.flink.metrics.otel with annotations of type Internal Modifier and Type Method Description static void
OpenTelemetryReporterOptions. tryConfigureEndpoint(MetricConfig metricConfig, Consumer<String> builder)
static void
OpenTelemetryReporterOptions. tryConfigureTimeout(MetricConfig metricConfig, Consumer<Duration> builder)
-
Uses of Internal in org.apache.flink.orc.writer
Classes in org.apache.flink.orc.writer with annotations of type Internal Modifier and Type Class Description class
OrcBulkWriter<T>
ABulkWriter
implementation that writes data in ORC format.class
PhysicalWriterImpl
A slightly customised clone ofPhysicalFsWriter
.class
ThreadLocalClassLoaderConfiguration
Workaround for https://issues.apache.org/jira/browse/ORC-653. -
Uses of Internal in org.apache.flink.python
Classes in org.apache.flink.python with annotations of type Internal Modifier and Type Class Description class
PythonConfig
Configurations for the Python job which are used at run time.interface
PythonFunctionRunner
The base interface of runner which is responsible for the execution of Python functions.Methods in org.apache.flink.python with annotations of type Internal Modifier and Type Method Description Map<String,String>
PythonConfig. toMap()
-
Uses of Internal in org.apache.flink.python.env
Classes in org.apache.flink.python.env with annotations of type Internal Modifier and Type Class Description class
AbstractPythonEnvironmentManager
The base class of python environment manager which is used to create the PythonEnvironment object used to execute Python functions.class
PythonDependencyInfo
PythonDependencyInfo contains the information of third-party dependencies.interface
PythonEnvironment
The base interface of python environment for executing UDFs.interface
PythonEnvironmentManager
The base interface of python environment manager which is used to create the PythonEnvironment object used to execute Python functions. -
Uses of Internal in org.apache.flink.python.env.embedded
Classes in org.apache.flink.python.env.embedded with annotations of type Internal Modifier and Type Class Description class
EmbeddedPythonEnvironment
APythonEnvironment
for executing UDFs in embedded environment.class
EmbeddedPythonEnvironmentManager
The base class of python environment manager which is used to create the PythonEnvironment object. -
Uses of Internal in org.apache.flink.python.env.process
Classes in org.apache.flink.python.env.process with annotations of type Internal Modifier and Type Class Description class
ProcessPythonEnvironment
APythonEnvironment
for executing UDFs in Process.class
ProcessPythonEnvironmentManager
The ProcessPythonEnvironmentManager is used to prepare the working dir of python UDF worker and create ProcessPythonEnvironment object of Beam Fn API. -
Uses of Internal in org.apache.flink.python.legacy
Classes in org.apache.flink.python.legacy with annotations of type Internal Modifier and Type Class Description class
IdPartitioner
Partitioner that partitions by id. -
Uses of Internal in org.apache.flink.python.metric.embedded
Classes in org.apache.flink.python.metric.embedded with annotations of type Internal Modifier and Type Class Description class
MetricDistribution
FlinkGauge
for Python Distribution.class
MetricGauge
FlinkGauge
for Python Gauge. -
Uses of Internal in org.apache.flink.python.metric.process
Classes in org.apache.flink.python.metric.process with annotations of type Internal Modifier and Type Class Description class
FlinkMetricContainer
Helper class for forwarding Python metrics to Java accumulators and metrics. -
Uses of Internal in org.apache.flink.python.util
Classes in org.apache.flink.python.util with annotations of type Internal Modifier and Type Class Description class
HashMapWrapper
Helper class to create aHashMap
taking Numeric data as key or value from Python side.class
ProtoUtils
Utilities used to construct protobuf objects or construct objects from protobuf objects.class
PythonDependencyUtils
Utility class for Python dependency management.class
PythonEnvironmentManagerUtils
Utils used to prepare the python environment. -
Uses of Internal in org.apache.flink.queryablestate.client
Classes in org.apache.flink.queryablestate.client with annotations of type Internal Modifier and Type Class Description class
VoidNamespace
Singleton placeholder class for state without a namespace.class
VoidNamespaceSerializer
Serializer forVoidNamespace
.class
VoidNamespaceTypeInfo
-
Uses of Internal in org.apache.flink.queryablestate.client.proxy
Classes in org.apache.flink.queryablestate.client.proxy with annotations of type Internal Modifier and Type Class Description class
KvStateClientProxyHandler
This handler acts as an internal (to the Flink cluster) client that receives the requests from external clients, executes them by contacting the Job Manager (if necessary) and the Task Manager holding the requested state, and forwards the answer back to the client.class
KvStateClientProxyImpl
The default implementation of theKvStateClientProxy
. -
Uses of Internal in org.apache.flink.queryablestate.exceptions
Classes in org.apache.flink.queryablestate.exceptions with annotations of type Internal Modifier and Type Class Description class
UnknownKeyOrNamespaceException
Thrown if the KvState does not hold any state for the given key or namespace.class
UnknownKvStateIdException
Thrown if no KvState with the given ID cannot found by the server handler.class
UnknownKvStateKeyGroupLocationException
Exception thrown if there is no location information available for the given key group.class
UnknownLocationException
Exception to fail Future if the Task Manager on which theClient Proxy
is running on, does not know the location of a requested state. -
Uses of Internal in org.apache.flink.queryablestate.messages
Classes in org.apache.flink.queryablestate.messages with annotations of type Internal Modifier and Type Class Description class
KvStateInternalRequest
The request to be forwarded by theQueryable State Client Proxy
to theState Server
of the Task Manager responsible for the requested state.class
KvStateRequest
The request to be sent by theQueryable State Client
to the Client Proxy requesting a given state.class
KvStateResponse
The response containing the (serialized) state sent by theState Server
to theClient Proxy
, and then forwarded by the proxy to the originalQueryable State Client
. -
Uses of Internal in org.apache.flink.queryablestate.network
Classes in org.apache.flink.queryablestate.network with annotations of type Internal Modifier and Type Class Description class
AbstractServerBase<REQ extends MessageBody,RESP extends MessageBody>
The base class for every server in the queryable state module.class
AbstractServerHandler<REQ extends MessageBody,RESP extends MessageBody>
The base class of every handler used by anAbstractServerBase
.class
BadRequestException
Base class for exceptions thrown during querying Flink's managed state.class
ChunkedByteBuf
AByteBuf
instance to be consumed in chunks byChunkedWriteHandler
, respecting the high and low watermarks.class
Client<REQ extends MessageBody,RESP extends MessageBody>
The base class for every client in the queryable state module.class
ClientHandler<REQ extends MessageBody,RESP extends MessageBody>
The handler used by aClient
to handling incoming messages.interface
ClientHandlerCallback<RESP extends MessageBody>
Callback forClientHandler
. -
Uses of Internal in org.apache.flink.queryablestate.network.messages
Classes in org.apache.flink.queryablestate.network.messages with annotations of type Internal Modifier and Type Class Description class
MessageBody
interface
MessageDeserializer<M extends MessageBody>
A utility used to deserialize amessage
.class
MessageSerializer<REQ extends MessageBody,RESP extends MessageBody>
class
MessageType
class
RequestFailure
A message indicating a protocol-related error. -
Uses of Internal in org.apache.flink.queryablestate.server
Classes in org.apache.flink.queryablestate.server with annotations of type Internal Modifier and Type Class Description class
KvStateServerHandler
This handler dispatches asynchronous tasks, which queryInternalKvState
instances and write the result to the channel.class
KvStateServerImpl
The default implementation of theKvStateServer
. -
Uses of Internal in org.apache.flink.runtime.asyncprocessing
Classes in org.apache.flink.runtime.asyncprocessing with annotations of type Internal Modifier and Type Class Description class
ReferenceCounted<ReleaseHelper>
An object that can be reference counted, the internal resource would be released when the reference count reaches zero.interface
StateExecutor
Executor for executing batchStateRequest
s.interface
StateRequestHandler
The handler which can processStateRequest
. -
Uses of Internal in org.apache.flink.runtime.asyncprocessing.operators
Classes in org.apache.flink.runtime.asyncprocessing.operators with annotations of type Internal Modifier and Type Class Description class
AbstractAsyncStateStreamOperator<OUT>
This operator is an abstract class that give theAbstractStreamOperator
the ability to performAsyncStateProcessing
.class
AbstractAsyncStateStreamOperatorV2<OUT>
This operator is an abstract class that give theAbstractStreamOperatorV2
the ability to performAsyncStateProcessing
.class
AbstractAsyncStateUdfStreamOperator<OUT,F extends Function>
This is used as the base class for operators that have a user-defined function. -
Uses of Internal in org.apache.flink.runtime.checkpoint
Classes in org.apache.flink.runtime.checkpoint with annotations of type Internal Modifier and Type Class Description class
CheckpointRetentionPolicy
Policy for whether checkpoints are retained after a job terminates.class
CheckpointType
The type of checkpoint to perform.class
CompletedCheckpointStatsSummarySnapshot
Immutable snapshot ofCompletedCheckpointStatsSummary
.interface
OperatorStateRepartitioner<T>
Interface that allows to implement different strategies for repartitioning of operator state as parallelism changes.static interface
PerJobCheckpointRecoveryFactory.CheckpointStoreRecoveryHelper<StoreType extends CompletedCheckpointStore>
Restores or creates aCompletedCheckpointStore
, optionally using an existing one.class
PrioritizedOperatorSubtaskState
This class is a wrapper over multiple alternativeOperatorSubtaskState
that are (partial) substitutes for each other and imposes a priority ordering over all alternatives for the different states which define an order in which the operator should attempt to restore the state from them.static class
PrioritizedOperatorSubtaskState.Builder
A builder for PrioritizedOperatorSubtaskState.class
RoundRobinOperatorStateRepartitioner
Current default implementation ofOperatorStateRepartitioner
that redistributes state in round robin fashion.class
StateAssignmentOperation
This class encapsulates the operation of assigning restored state when restoring from a checkpoint.class
StatsSummarySnapshot
Immutable snapshot ofStatsSummary
. -
Uses of Internal in org.apache.flink.runtime.checkpoint.channel
Classes in org.apache.flink.runtime.checkpoint.channel with annotations of type Internal Modifier and Type Interface Description interface
ChannelStateWriter
Writes channel state during checkpoint/savepoint.class
ChannelStateWriterImpl
ChannelStateWriter
implemented usingCheckpointStateOutputStreams
.class
InputChannelInfo
IdentifiesInputChannel
in a given subtask.class
ResultSubpartitionInfo
IdentifiesResultSubpartition
in a given subtask.interface
SequentialChannelStateReader
Reads channel state saved during checkpoint/savepoint. -
Uses of Internal in org.apache.flink.runtime.checkpoint.metadata
Classes in org.apache.flink.runtime.checkpoint.metadata with annotations of type Internal Modifier and Type Class Description class
MetadataV1Serializer
Deserializer for checkpoints written in format1
(Flink 1.2.x format).class
MetadataV2Serializer
(De)serializer for checkpoint metadata format version 2.class
MetadataV2V3SerializerBase
Base (De)serializer for checkpoint metadata format version 2 and 3.class
MetadataV3Serializer
(De)serializer for checkpoint metadata format version 3.class
MetadataV4Serializer
V4 serializer that addsCheckpointProperties
serialization.class
MetadataV5Serializer
V5 serializer that adds Operator name and uid. -
Uses of Internal in org.apache.flink.runtime.dispatcher
Classes in org.apache.flink.runtime.dispatcher with annotations of type Internal Modifier and Type Class Description class
ConfigurationNotAllowedMessage
IfDeploymentOptions.PROGRAM_CONFIG_ENABLED
is disabled, this error denotes the not allowed configuration.interface
DispatcherBootstrap
An interface containing the logic of bootstrapping theDispatcher
of a cluster.interface
DispatcherBootstrapFactory
A factory to create aDispatcherBootstrap
.class
NoOpDispatcherBootstrap
ADispatcherBootstrap
which submits the providedjob graphs
for execution upon dispatcher initialization.Fields in org.apache.flink.runtime.dispatcher with annotations of type Internal Modifier and Type Field Description static ConfigOption<Duration>
Dispatcher. CLIENT_ALIVENESS_CHECK_DURATION
-
Uses of Internal in org.apache.flink.runtime.dispatcher.runner
Classes in org.apache.flink.runtime.dispatcher.runner with annotations of type Internal Modifier and Type Class Description class
AbstractDispatcherLeaderProcess
A baseDispatcherLeaderProcess
.class
DefaultDispatcherGatewayService
A facade over theDispatcher
that exposes specific functionality.interface
DispatcherLeaderProcessFactoryFactory
Factory forDispatcherLeaderProcessFactory
.class
SessionDispatcherLeaderProcessFactory
Factory for theSessionDispatcherLeaderProcess
. -
Uses of Internal in org.apache.flink.runtime.entrypoint
Fields in org.apache.flink.runtime.entrypoint with annotations of type Internal Modifier and Type Field Description static ConfigOption<String>
ClusterEntrypoint. INTERNAL_CLUSTER_EXECUTION_MODE
-
Uses of Internal in org.apache.flink.runtime.entrypoint.component
Fields in org.apache.flink.runtime.entrypoint.component with annotations of type Internal Modifier and Type Field Description static ConfigOption<String>
FileJobGraphRetriever. JOB_GRAPH_FILE_PATH
-
Uses of Internal in org.apache.flink.runtime.entrypoint.parser
Classes in org.apache.flink.runtime.entrypoint.parser with annotations of type Internal Modifier and Type Class Description class
ConfigurationCommandLineOptions
Represents the set of command-line options related to update and get configuration. -
Uses of Internal in org.apache.flink.runtime.executiongraph
Classes in org.apache.flink.runtime.executiongraph with annotations of type Internal Modifier and Type Class Description class
SimpleInitializeOnMasterContext
A simple pojo based implementation ofJobVertex.InitializeOnMasterContext
. -
Uses of Internal in org.apache.flink.runtime.fs.hdfs
Classes in org.apache.flink.runtime.fs.hdfs with annotations of type Internal Modifier and Type Class Description class
BaseHadoopFsRecoverableFsDataOutputStream
Base class for ABFS and Hadoop recoverable stream.class
HadoopFsRecoverable
An implementation of the resume and commit descriptor objects for Hadoop's/AzureBlob file system abstraction.class
HadoopRecoverableWriter
An implementation of theRecoverableWriter
for Hadoop's file system abstraction. -
Uses of Internal in org.apache.flink.runtime.highavailability
Classes in org.apache.flink.runtime.highavailability with annotations of type Internal Modifier and Type Interface Description interface
JobResultStore
A storage for the results of globally terminated jobs. -
Uses of Internal in org.apache.flink.runtime.io
Classes in org.apache.flink.runtime.io with annotations of type Internal Modifier and Type Interface Description interface
AvailabilityProvider
Interface defining couple of essential methods for listening on data availability usingCompletableFuture
.interface
PullingAsyncDataInput<T>
Interface defining couple of essential methods for asynchronous and non blocking data polling. -
Uses of Internal in org.apache.flink.runtime.io.disk
Classes in org.apache.flink.runtime.io.disk with annotations of type Internal Modifier and Type Class Description class
FileBasedBufferIterator
CloseableIterator
ofbuffers
over file content. -
Uses of Internal in org.apache.flink.runtime.io.network.api
Classes in org.apache.flink.runtime.io.network.api with annotations of type Internal Modifier and Type Class Description class
EndOfSegmentEvent
EndOfSegmentEvent
is used to notify the downstream switch tiers in tiered storage shuffle mode.class
RecoveryMetadata
RecoveryMetadata
contains the metadata used during a recovery process.class
StopMode
Tells if the job is stopping because of consuming all data. -
Uses of Internal in org.apache.flink.runtime.io.network.api.writer
Classes in org.apache.flink.runtime.io.network.api.writer with annotations of type Internal Modifier and Type Class Description class
SubtaskStateMapper
TheSubtaskStateMapper
narrows down the subtasks that need to be read during rescaling to recover from a particular subtask when in-flight data has been stored in the checkpoint. -
Uses of Internal in org.apache.flink.runtime.io.network.partition
Classes in org.apache.flink.runtime.io.network.partition with annotations of type Internal Modifier and Type Class Description class
PrioritizedDeque<T>
A deque-like data structure that supports prioritization of elements, such they will be polled before any non-priority elements. -
Uses of Internal in org.apache.flink.runtime.io.network.partition.consumer
Classes in org.apache.flink.runtime.io.network.partition.consumer with annotations of type Internal Modifier and Type Interface Description interface
CheckpointableInput
Input, with just basic methods for blocking and resuming consumption. -
Uses of Internal in org.apache.flink.runtime.jobgraph.jsonplan
Classes in org.apache.flink.runtime.jobgraph.jsonplan with annotations of type Internal Modifier and Type Class Description class
JsonPlanGenerator
-
Uses of Internal in org.apache.flink.runtime.jobgraph.tasks
Classes in org.apache.flink.runtime.jobgraph.tasks with annotations of type Internal Modifier and Type Interface Description interface
CheckpointableTask
A task that participates in checkpointing.interface
CoordinatedTask
An task that is coordinated, i.e. contains operators coordinated byOperatorCoordinator
.interface
TaskInvokable
An invokable part of the task. -
Uses of Internal in org.apache.flink.runtime.jobmaster
Classes in org.apache.flink.runtime.jobmaster with annotations of type Internal Modifier and Type Class Description static class
JobResult.Builder
Builder forJobResult
. -
Uses of Internal in org.apache.flink.runtime.metrics.groups
Classes in org.apache.flink.runtime.metrics.groups with annotations of type Internal Modifier and Type Class Description class
AbstractMetricGroup<A extends AbstractMetricGroup<?>>
AbstractMetricGroup
that contains key functionality for adding metrics and groups.class
ComponentMetricGroup<P extends AbstractMetricGroup<?>>
AbstractMetricGroup
for system components (e.g., TaskManager, Job, Task, Operator).class
GenericKeyMetricGroup
AGenericMetricGroup
for representing the key part of a key-value metric group pair.class
GenericMetricGroup
A simple namedMetricGroup
that is used to hold subgroups of metrics.class
GenericValueMetricGroup
AGenericMetricGroup
for representing the value part of a key-value metric group pair.class
InternalCacheMetricGroup
ACacheMetricGroup
which register all cache related metrics under a subgroup of the parent metric group.class
InternalOperatorCoordinatorMetricGroup
SpecialMetricGroup
representing an OperatorCoordinator.class
InternalOperatorIOMetricGroup
Metric group that contains shareable pre-defined IO-related metrics.class
InternalOperatorMetricGroup
SpecialMetricGroup
representing an Operator.class
InternalSinkCommitterMetricGroup
SpecialMetricGroup
representing an Operator.class
InternalSinkWriterMetricGroup
SpecialMetricGroup
representing an Operator.class
InternalSourceReaderMetricGroup
SpecialMetricGroup
representing an Operator.class
InternalSplitEnumeratorMetricGroup
SpecialMetricGroup
representing anSplitEnumerator
.class
JobManagerJobMetricGroup
SpecialMetricGroup
representing everything belonging to a specific job, running on the JobManager.class
JobMetricGroup<C extends ComponentMetricGroup<C>>
Special abstractMetricGroup
representing everything belonging to a specific job.class
TaskManagerJobMetricGroup
SpecialMetricGroup
representing everything belonging to a specific job, running on the TaskManager.class
TaskManagerMetricGroup
SpecialMetricGroup
representing a TaskManager.class
TaskMetricGroup
SpecialMetricGroup
representing a Flink runtime Task. -
Uses of Internal in org.apache.flink.runtime.minicluster
Methods in org.apache.flink.runtime.minicluster with annotations of type Internal Modifier and Type Method Description void
MiniCluster. overrideRestoreModeForChangelogStateBackend()
-
Uses of Internal in org.apache.flink.runtime.operators.coordination
Classes in org.apache.flink.runtime.operators.coordination with annotations of type Internal Modifier and Type Interface Description interface
CoordinatorStore
CoordinatorStore
can be used for sharing some information amongOperatorCoordinator
instances.class
CoordinatorStoreImpl
Basic implementation ofCoordinatorStore
.interface
OperatorCoordinator
A coordinator for runtime operators. -
Uses of Internal in org.apache.flink.runtime.query
Classes in org.apache.flink.runtime.query with annotations of type Internal Modifier and Type Class Description class
KvStateEntry<K,N,V>
An entry holding theInternalKvState
along with itsKvStateInfo
. -
Uses of Internal in org.apache.flink.runtime.rest.handler.job.checkpoints
Classes in org.apache.flink.runtime.rest.handler.job.checkpoints with annotations of type Internal Modifier and Type Class Description class
AbstractCheckpointStatsHandler<R extends ResponseBody,M extends JobMessageParameters>
Abstract class for checkpoint handlers that will cache theCheckpointStatsSnapshot
object. -
Uses of Internal in org.apache.flink.runtime.rest.handler.job.metrics
Classes in org.apache.flink.runtime.rest.handler.job.metrics with annotations of type Internal Modifier and Type Class Description class
JobManagerOperatorMetricsHandler
Handler that returns job manager operator metrics. -
Uses of Internal in org.apache.flink.runtime.rest.messages.job.metrics
Classes in org.apache.flink.runtime.rest.messages.job.metrics with annotations of type Internal Modifier and Type Class Description class
JobManagerOperatorMetricsHeaders
class
JobManagerOperatorMetricsMessageParameters
-
Uses of Internal in org.apache.flink.runtime.scheduler.adaptive
Classes in org.apache.flink.runtime.scheduler.adaptive with annotations of type Internal Modifier and Type Class Description class
JobSchedulingPlan
A plan that describes how to executeJobGraph
. -
Uses of Internal in org.apache.flink.runtime.scheduler.adaptive.allocator
Classes in org.apache.flink.runtime.scheduler.adaptive.allocator with annotations of type Internal Modifier and Type Class Description class
JobAllocationsInformation
Information about allocations of Job Vertices.interface
SlotAssigner
Interface for assigning slots to slot sharing groups.class
StateLocalitySlotAssigner
ASlotAssigner
that assigns slots based on the number of local key groups.class
StateSizeEstimates
Managed Keyed State size estimates used to make scheduling decisions. -
Uses of Internal in org.apache.flink.runtime.security
Classes in org.apache.flink.runtime.security with annotations of type Internal Modifier and Type Class Description class
KerberosUtils
Provides vendor-specific KerberosAppConfigurationEntry
instances. -
Uses of Internal in org.apache.flink.runtime.security.modules
Classes in org.apache.flink.runtime.security.modules with annotations of type Internal Modifier and Type Class Description class
JaasModule
Responsible for installing a process-wide JAAS configuration. -
Uses of Internal in org.apache.flink.runtime.security.token
Classes in org.apache.flink.runtime.security.token with annotations of type Internal Modifier and Type Class Description class
DefaultDelegationTokenManager
Manager for delegation tokens in a Flink cluster.class
DefaultDelegationTokenManagerFactory
A factory forDefaultDelegationTokenManager
.interface
DelegationTokenManager
Manager for delegation tokens in a Flink cluster.static interface
DelegationTokenManager.Listener
Listener for events in theDelegationTokenManager
.class
DelegationTokenReceiverRepository
Repository for delegation token receivers.class
NoOpDelegationTokenManager
DelegationTokenManager
implementation which does nothing. -
Uses of Internal in org.apache.flink.runtime.security.token.hadoop
Classes in org.apache.flink.runtime.security.token.hadoop with annotations of type Internal Modifier and Type Class Description class
HadoopDelegationTokenConverter
Delegation token serializer and deserializer functionality.class
HadoopDelegationTokenReceiver
Hadoop delegation token receiver base class.class
HadoopFSDelegationTokenProvider
Delegation token provider for Hadoop filesystems.class
HadoopFSDelegationTokenReceiver
Delegation token receiver for Hadoop filesystems.class
HBaseDelegationTokenProvider
Delegation token provider implementation for HBase.class
HBaseDelegationTokenReceiver
Delegation token receiver implementation for HBase.class
KerberosLoginProvider
Provides Kerberos login functionality. -
Uses of Internal in org.apache.flink.runtime.source.coordinator
Classes in org.apache.flink.runtime.source.coordinator with annotations of type Internal Modifier and Type Class Description class
SourceCoordinator<SplitT extends SourceSplit,EnumChkT>
The default implementation of theOperatorCoordinator
for theSource
.class
SourceCoordinatorContext<SplitT extends SourceSplit>
A context class for theOperatorCoordinator
.class
SplitAssignmentTracker<SplitT extends SourceSplit>
A class that is responsible for tracking the past split assignments made bySplitEnumerator
. -
Uses of Internal in org.apache.flink.runtime.state
Classes in org.apache.flink.runtime.state with annotations of type Internal Modifier and Type Class Description class
AbstractChannelStateHandle<Info>
Abstract channel state handle.interface
AsyncKeyedStateBackend<K>
An async keyed state backend provides methods supporting to access keyed state asynchronously and in batch.class
CheckpointStateOutputStream
A dedicated output stream that produces aStreamStateHandle
when closed.interface
CheckpointStateToolset
A toolset of operations that can be performed on a location embedded within the class.class
CheckpointStorageLoader
This class contains utility methods to load checkpoint storage from configurations.interface
CheckpointStorageWorkerView
This interface implements the durable storage of checkpoint data and metadata streams.interface
ConfigurableCheckpointStorage
An interface for checkpoint storage types that pick up additional parameters from a configuration.interface
ConfigurableStateBackend
An interface for state backends that pick up additional parameters from a configuration.class
DefaultOperatorStateBackend
Default implementation of OperatorStateStore that provides the ability to make snapshots.interface
FullSnapshotResources<K>
ASnapshotResources
to be used with the backend-independentFullSnapshotAsyncWriter
.class
HeapPriorityQueuesManager
Manages creating heap priority queues along with their counterpart meta info.class
InputChannelStateHandle
Handle
to anInputChannel
state.interface
InternalKeyContext<K>
This interface is the current context of a keyed state.interface
InternalPriorityQueue<T>
Interface for collection that gives in order access to elements w.r.t their priority.interface
IterableStateSnapshot<K,N,S>
AStateSnapshot
that can return an iterator over all containedStateEntries
.class
JavaSerializer<T extends Serializable>
ATypeSerializer
that uses Java serialization.class
KeyedStateBackendParametersImpl<K>
Internal POJO implementingStateBackend.KeyedStateBackendParameters
class
OperatorStateBackendParametersImpl
Internal POJO implementingStateBackend.OperatorStateBackendParameters
interface
OwnedTaskLocalStateStore
This interface represents the administrative interface toTaskLocalStateStore
, that only the owner of the object should see.class
ResultSubpartitionStateHandle
Handle
to aResultSubpartition
state.class
SavepointResources<K>
Savepoint resources for aKeyedStateBackend
.class
SerializedCompositeKeyBuilder<K>
Responsible for serialization of currentKey, currentGroup and namespace.class
SharedStateRegistryImpl
SharedStateRegistry
implementation.class
SnappyStreamCompressionDecorator
This implementation decorates the stream with snappy compression.interface
Snapshotable<S extends StateObject>
Interface for objects that can snapshot its state (state backends currently).interface
SnapshotResources
A set of resources produced in the synchronous part of a snapshot required to finish the snapshot.interface
SnapshotStrategy<S extends StateObject,SR extends SnapshotResources>
Interface for different snapshot approaches in state backends.class
StateSerializerProvider<T>
AStateSerializerProvider
wraps logic on how to obtain serializers for registered state, either with the previous schema of state in checkpoints or the current schema of state.interface
StateSnapshot
General interface for state snapshots that should be written partitioned by key-groups.interface
StateSnapshotKeyGroupReader
Interface for state de-serialization intoStateTable
s by key-group.interface
StateSnapshotRestore
Interface to deal with state snapshot and restore of state.interface
StateTransformationFunction<S,T>
Interface for a binary function that is used for push-down of state transformation into state backends.class
StreamCompressionDecorator
Implementations of this interface decorate streams with a compression scheme.interface
TaskLocalStateStore
Classes that implement this interface serve as a task-manager-level local storage for local checkpointed state.class
UncompressedStreamCompressionDecorator
This implementation does not decorate the stream with any compression. -
Uses of Internal in org.apache.flink.runtime.state.changelog
Classes in org.apache.flink.runtime.state.changelog with annotations of type Internal Modifier and Type Interface Description interface
ChangelogStateBackendHandle
A handle to ChangelogStateBackend state.interface
ChangelogStateHandle
A handle to savedstate changes
.class
ChangelogStateHandleStreamImpl
ChangelogStateHandle
implementation based onStreamStateHandle
.interface
LocalChangelogRegistry
This registry is responsible for deleting changlog's local handles which are not in use.class
LocalChangelogRegistryImpl
interface
SequenceNumber
A logical timestamp to draw a boundary between the materialized and non-materialized changes.class
StateChange
Change of state of a keyed operator.interface
StateChangelogHandleReader<Handle extends ChangelogStateHandle>
Allows to read state changelog referenced by the providedChangelogStateHandle
.class
StateChangelogHandleStreamHandleReader
A reader forChangelogStateHandleStreamImpl
that iterates over its underlyingstream handles
and offsets.interface
StateChangelogStorage<Handle extends ChangelogStateHandle>
A storage for changelog.interface
StateChangelogStorageFactory
A factory forStateChangelogStorage
.class
StateChangelogStorageLoader
A thin wrapper aroundPluginManager
to loadStateChangelogStorage
.interface
StateChangelogStorageView<Handle extends ChangelogStateHandle>
A storage view for changelog.interface
StateChangelogWriter<Handle extends ChangelogStateHandle>
Allows to write data to the log. -
Uses of Internal in org.apache.flink.runtime.state.changelog.inmemory
Classes in org.apache.flink.runtime.state.changelog.inmemory with annotations of type Internal Modifier and Type Class Description class
InMemoryChangelogStateHandle
In-memoryChangelogStateHandle
. -
Uses of Internal in org.apache.flink.runtime.state.delegate
Classes in org.apache.flink.runtime.state.delegate with annotations of type Internal Modifier and Type Interface Description interface
DelegatingStateBackend
An interface to delegate state backend. -
Uses of Internal in org.apache.flink.runtime.state.filesystem
Classes in org.apache.flink.runtime.state.filesystem with annotations of type Internal Modifier and Type Class Description class
FSDataOutputStreamWrapper
Implementation ofMetadataOutputStreamWrapper
encapsulates theFSDataOutputStream
forFsCheckpointMetadataOutputStream
.class
MetadataOutputStreamWrapper
The wrapper manages metadata output stream close and commit.class
RecoverableStreamWrapper
Implementation ofMetadataOutputStreamWrapper
encapsulates theRecoverableFsDataOutputStream
forFsCheckpointMetadataOutputStream
.Methods in org.apache.flink.runtime.state.filesystem with annotations of type Internal Modifier and Type Method Description static FsCompletedCheckpointStorageLocation
AbstractFsCheckpointStorageAccess. resolveCheckpointPointer(String checkpointPointer)
Takes the given string (representing a pointer to a checkpoint) and resolves it to a file status for the checkpoint's metadata file. -
Uses of Internal in org.apache.flink.runtime.state.heap
Classes in org.apache.flink.runtime.state.heap with annotations of type Internal Modifier and Type Class Description class
CopyOnWriteStateTableSnapshot<K,N,S>
This class represents the snapshot of aCopyOnWriteStateTable
and has a role in operator state checkpointing.class
HeapKeyValueStateIterator
AKeyValueStateIterator
over Heap backend snapshot resources.interface
HeapPriorityQueueElement
Interface for objects that can be managed by aHeapPriorityQueue
.class
StateTableByKeyGroupReaders
This class provides a static factory method to create different implementations ofStateSnapshotKeyGroupReader
depending on the provided serialization format version. -
Uses of Internal in org.apache.flink.runtime.state.metrics
Classes in org.apache.flink.runtime.state.metrics with annotations of type Internal Modifier and Type Class Description class
LatencyTrackingStateConfig
Config to create latency tracking state metric. -
Uses of Internal in org.apache.flink.runtime.state.restore
Classes in org.apache.flink.runtime.state.restore with annotations of type Internal Modifier and Type Class Description class
FullSnapshotRestoreOperation<K>
The procedure of restoring state from a savepoint written with the unified binary format.class
KeyGroup
Part of a savepoint representing data for a single key group.class
KeyGroupEntry
Part of a savepoint representing data for a single state entry in a key group.interface
ThrowingIterator<E>
ModifiedIterator
interface that lets the implementation throw anIOException
. -
Uses of Internal in org.apache.flink.runtime.state.v2
Classes in org.apache.flink.runtime.state.v2 with annotations of type Internal Modifier and Type Class Description class
AbstractKeyedState<K,N,V>
TheAbstractKeyedState
is the root of the abstract state implementation hierarchy, similar to theState
being the root of the public API state hierarchy.interface
KeyedStateStoreV2
This interface contains methods for registeringState
.class
StateDescriptor<T>
Base class for state descriptors. -
Uses of Internal in org.apache.flink.runtime.state.v2.internal
Classes in org.apache.flink.runtime.state.v2.internal with annotations of type Internal Modifier and Type Interface Description interface
InternalKeyedState<K,N,V>
This class defines the internal interface for all keyed state.interface
InternalListState<K,N,V>
This class defines the internal interface for list state.interface
InternalMapState<K,N,UK,UV>
This class defines the internal interface for map state.interface
InternalPartitionedState<N>
A state that is partitioned into different namespaces.interface
InternalValueState<K,N,V>
This class defines the internal interface for value state. -
Uses of Internal in org.apache.flink.runtime.taskmanager
Classes in org.apache.flink.runtime.taskmanager with annotations of type Internal Modifier and Type Class Description class
AsynchronousException
An exception for wrapping exceptions that are thrown by an operator in threads other than the main compute thread of that operator.interface
CheckpointResponder
Responder for checkpoint acknowledge and decline messages in theTask
. -
Uses of Internal in org.apache.flink.runtime.util
Classes in org.apache.flink.runtime.util with annotations of type Internal Modifier and Type Class Description class
ForwardingInputStream
Input stream, that wraps another input stream and forwards all method calls to the wrapped stream.class
ForwardingOutputStream
OutputStream
, that wraps anotherOutputStream
and forwards all method calls to the wrapped stream.class
NonClosingInputStreamDecorator
Decorator for input streams that ignores calls toInputStream.close()
.class
NonClosingOutputStreamDecorator
Decorator for input streams that ignores calls toOutputStream.close()
. -
Uses of Internal in org.apache.flink.sql.parser.ddl
Classes in org.apache.flink.sql.parser.ddl with annotations of type Internal Modifier and Type Class Description class
SqlCompilePlan
AST node forCOMPILE PLAN 'planfile' [IF NOT EXISTS] FOR [DML]
.class
SqlReset
SQL call for "RESET" and "RESET 'key'".class
SqlSet
SQL call for "SET" and "SET 'key' = 'value'". -
Uses of Internal in org.apache.flink.sql.parser.dml
Classes in org.apache.flink.sql.parser.dml with annotations of type Internal Modifier and Type Class Description class
SqlCompileAndExecutePlan
AST node forCOMPILE AND EXECUTE PLAN 'planfile' FOR [DML]
.class
SqlExecutePlan
AST node forEXECUTE PLAN 'planfile'
. -
Uses of Internal in org.apache.flink.sql.parser.type
Classes in org.apache.flink.sql.parser.type with annotations of type Internal Modifier and Type Class Description class
SqlRawTypeNameSpec
Represents a raw type such asRAW('org.my.Class', 'sW3Djsds...')
.class
SqlTimestampLtzTypeNameSpec
Represents type TIMESTAMP_LTZ(int) which is a synonym of type TIMESTAMP(int) WITH LOCAL TIME ZONE. -
Uses of Internal in org.apache.flink.state.api
Methods in org.apache.flink.state.api with annotations of type Internal Modifier and Type Method Description OperatorID
OperatorIdentifier. getOperatorId()
Optional<String>
OperatorIdentifier. getUid()
<R> StateBootstrapTransformation<T>
WindowedStateTransformation. reduce(ReduceFunction<T> reduceFunction, ProcessWindowFunction<T,R,K,W> function)
Applies the given window function to each window. -
Uses of Internal in org.apache.flink.state.api.input
Classes in org.apache.flink.state.api.input with annotations of type Internal Modifier and Type Class Description class
BroadcastStateInputFormat<K,V>
The input format for readingBroadcastState
.class
KeyedStateInputFormat<K,N,OUT>
Input format for reading partitioned state.class
ListStateInputFormat<OT>
Input format for reading operator list state.class
MultiStateKeyIterator<K>
An iterator for reading all keys in a state backend across multiple partitioned states.class
SourceBuilder
A utility for constructingInputFormat
based sources that are marked as BOUNDED.class
UnionStateInputFormat<OT>
Input format for reading operator union state. -
Uses of Internal in org.apache.flink.state.api.input.operator
Classes in org.apache.flink.state.api.input.operator with annotations of type Internal Modifier and Type Class Description class
KeyedStateReaderOperator<KEY,OUT>
AStateReaderOperator
for executing aKeyedStateReaderFunction
.class
StateReaderOperator<F extends Function,KEY,N,OUT>
Base class for executing functions that read keyed state.class
WindowReaderOperator<S extends State,KEY,IN,W extends Window,OUT>
AStateReaderOperator
for readingWindowOperator
state. -
Uses of Internal in org.apache.flink.state.api.input.operator.window
Classes in org.apache.flink.state.api.input.operator.window with annotations of type Internal Modifier and Type Class Description class
AggregateEvictingWindowReaderFunction<IN,ACC,R,OUT,KEY,W extends Window>
A wrapper for reading an evicting window operator with an aggregate function.class
EvictingWindowReaderFunction<IN,R,OUT,KEY,W extends Window>
Wrapper for reading state from an evicting window operator.class
ProcessEvictingWindowReader<IN,OUT,KEY,W extends Window>
A wrapper function for reading an evicting window with no pre-aggregation.class
ReduceEvictingWindowReaderFunction<IN,OUT,KEY,W extends Window>
A wrapper function for reading state from an evicting window operator with a reduce function. -
Uses of Internal in org.apache.flink.state.api.input.splits
Classes in org.apache.flink.state.api.input.splits with annotations of type Internal Modifier and Type Class Description class
KeyGroupRangeInputSplit
An input split representing a key-group range from a savepoint.class
OperatorStateInputSplit
An input split containing state handles for operator state.interface
PrioritizedOperatorSubtaskStateInputSplit
An input split that returnsPrioritizedOperatorSubtaskState
. -
Uses of Internal in org.apache.flink.state.api.output
Classes in org.apache.flink.state.api.output with annotations of type Internal Modifier and Type Class Description class
BootstrapStreamTaskRunner<IN>
The runtime for aBootstrapStreamTask
.class
FileCopyFunction
This output format copies files from an existing savepoint into a new directory.class
MergeOperatorStates
A reducer that aggregates multipleOperatorState
's into a singleCheckpointMetadata
.class
OperatorSubtaskStateReducer
A reducer that aggregates allOperatorSubtaskState
's for a particular operator into a singleOperatorState
.class
SavepointOutputFormat
An output format to serializeCheckpointMetadata
metadata to distributed storage.class
SnapshotUtils
Takes a final snapshot of the state of an operator subtask.class
StatePathExtractor
Extracts all file paths that are part of the providedOperatorState
.class
TaggedOperatorSubtaskState
A simple wrapper pojo that tagsOperatorSubtaskState
with metadata. -
Uses of Internal in org.apache.flink.state.api.output.operators
Classes in org.apache.flink.state.api.output.operators with annotations of type Internal Modifier and Type Class Description class
BroadcastStateBootstrapOperator<IN>
AStreamOperator
for executingBroadcastStateBootstrapFunction
's.class
GroupReduceOperator<IN,OUT>
An operator for executing aGroupReduceFunction
on a bounded DataStream.class
KeyedStateBootstrapOperator<K,IN>
AStreamOperator
for executingKeyedStateBootstrapFunction
's.class
LazyTimerService
A timer service that initializes its internal timer service lazily.class
StateBootstrapOperator<IN>
AStreamOperator
for executingStateBootstrapFunction
's.class
StateBootstrapWrapperOperator<IN,OUT,OP extends AbstractStreamOperator<OUT> & OneInputStreamOperator<IN,OUT>>
Wraps an existing operator so it can be bootstrapped. -
Uses of Internal in org.apache.flink.state.api.runtime
Classes in org.apache.flink.state.api.runtime with annotations of type Internal Modifier and Type Class Description class
MutableConfig
A utility for creating a mutableConfiguration
from aReadableConfig
.class
NeverFireProcessingTimeService
A processing time service whose timers never fire so all timers are included in savepoints.class
OperatorIDGenerator
Utility for generating Operator Id's from uid strings.class
SavepointEnvironment
A minimally implementedEnvironment
that provides the functionality required to run thestate-processor-api
.class
SavepointLoader
Utility class for loadingCheckpointMetadata
metadata.class
SavepointRuntimeContext
A streamingRuntimeContext
which delegates to the underlying batchRuntimeContext
along with a specifiedKeyedStateStore
.class
StateBootstrapTransformationWithID<T>
A simple container class that represents a newly bootstrapped operator state within savepoints.class
VoidTriggerable<K,N>
ATriggerable
that does nothing. -
Uses of Internal in org.apache.flink.state.api.runtime.metadata
Classes in org.apache.flink.state.api.runtime.metadata with annotations of type Internal Modifier and Type Class Description class
SavepointMetadataV2
Savepoint metadata that can be modified. -
Uses of Internal in org.apache.flink.state.changelog
Classes in org.apache.flink.state.changelog with annotations of type Internal Modifier and Type Class Description class
AbstractChangelogStateBackend
An abstract base implementation of theStateBackend
interface whose subclasses use delegatedStateBackend and State changes to restore.class
ChangelogKeyedStateBackend<K>
AKeyedStateBackend
that keeps state on the underlying delegated keyed state backend as well as on the state change log.interface
ChangelogState
State used byChangelogKeyedStateBackend
.class
ChangelogStateBackend
This state backend holds the working state in the underlying delegatedStateBackend, and forwards state changes to State Changelog.class
DeactivatedChangelogStateBackend
This state backend use delegatedStateBackend and State changes to restore to the delegatedStateBackend in which switching Changelog from enabled to disabled.interface
KvStateChangeLogger<Value,Namespace>
A logger for some key-partitioned state (not onlyValueState
.interface
StateChangeLogger<Value,Namespace>
Logs changes to a state created byChangelogKeyedStateBackend
.class
StateChangeOperation
The operation applied toChangelogState
. -
Uses of Internal in org.apache.flink.state.changelog.restore
Classes in org.apache.flink.state.changelog.restore with annotations of type Internal Modifier and Type Interface Description interface
ChangelogApplierFactory
StateChangeApplier
factory.class
ChangelogBackendRestoreOperation
RestoresChangelogKeyedStateBackend
from the providedhandles
.interface
ChangelogRestoreTarget<K>
Maintains metadata operation related to Changelog recovery.class
FunctionDelegationHelper
Delegating functions
are used to create metadata on recovery when the actual function code is not known yet.interface
StateChangeApplier
Applies state data change to some state. -
Uses of Internal in org.apache.flink.state.common
Classes in org.apache.flink.state.common with annotations of type Internal Modifier and Type Class Description class
ChangelogMaterializationMetricGroup
Metrics related to the materialization part of Changelog.class
PeriodicMaterializationManager
Stateless Materialization Manager. -
Uses of Internal in org.apache.flink.state.forst
Classes in org.apache.flink.state.forst with annotations of type Internal Modifier and Type Interface Description interface
ForStDBOperation
Data access operation to ForStDB.class
ForStNativeMetricMonitor
A monitor which pulls {RocksDB
} native metrics and forwards them to Flink's metric group.class
ForStProperty
RocksDB
properties that can be queried by Flink's metrics reporter. -
Uses of Internal in org.apache.flink.state.forst.restore
Classes in org.apache.flink.state.forst.restore with annotations of type Internal Modifier and Type Interface Description interface
ForStRestoreOperation
Interface for ForSt restore. -
Uses of Internal in org.apache.flink.state.forst.sync
Classes in org.apache.flink.state.forst.sync with annotations of type Internal Modifier and Type Class Description class
AbstractForStStateKeysIterator<K>
Base class for iterators over RocksDB column families. -
Uses of Internal in org.apache.flink.state.rocksdb
Classes in org.apache.flink.state.rocksdb with annotations of type Internal Modifier and Type Class Description class
RocksDBNativeMetricMonitor
A monitor which pulls {RocksDB
} native metrics and forwards them to Flink's metric group.class
RocksDBProperty
RocksDB
properties that can be queried by Flink's metrics reporter. -
Uses of Internal in org.apache.flink.state.rocksdb.iterator
Classes in org.apache.flink.state.rocksdb.iterator with annotations of type Internal Modifier and Type Class Description class
AbstractRocksStateKeysIterator<K>
Base class for iterators over RocksDB column families.interface
SingleStateIterator
An interface for iterating over a single state in a RocksDB state backend. -
Uses of Internal in org.apache.flink.state.rocksdb.restore
Classes in org.apache.flink.state.rocksdb.restore with annotations of type Internal Modifier and Type Interface Description interface
RocksDBRestoreOperation
Interface for RocksDB restore. -
Uses of Internal in org.apache.flink.streaming.api
Classes in org.apache.flink.streaming.api with annotations of type Internal Modifier and Type Class Description class
SimpleTimerService
Implementation ofTimerService
that uses aInternalTimerService
. -
Uses of Internal in org.apache.flink.streaming.api.checkpoint
Classes in org.apache.flink.streaming.api.checkpoint with annotations of type Internal Modifier and Type Interface Description interface
ExternallyInducedSource<T,CD>
Deprecated.This interface is based on theSourceFunction
API, which is due to be removed. -
Uses of Internal in org.apache.flink.streaming.api.connector.sink2
Classes in org.apache.flink.streaming.api.connector.sink2 with annotations of type Internal Modifier and Type Class Description class
CommittableMessageSerializer<CommT>
The serializer to serializeCommittableMessage
s in custom operators.class
GlobalCommitterOperator<CommT,GlobalCommT>
Implements theGlobalCommitter
. -
Uses of Internal in org.apache.flink.streaming.api.datastream
Classes in org.apache.flink.streaming.api.datastream with annotations of type Internal Modifier and Type Class Description static class
CoGroupedStreams.TaggedUnion<T1,T2>
Internal class for implementing tagged union co-group.static class
CoGroupedStreams.UnionSerializer<T1,T2>
class
KeyedPartitionWindowedStream<T,KEY>
KeyedPartitionWindowedStream
represents a data stream that collects all records with the same key separately into a full window.class
NonKeyedPartitionWindowedStream<T>
NonKeyedPartitionWindowedStream
represents a data stream that collects all records of each subtask separately into a full window.Methods in org.apache.flink.streaming.api.datastream with annotations of type Internal Modifier and Type Method Description static <T> DataStreamSink<T>
DataStreamSink. forSink(DataStream<T> inputStream, Sink<T> sink, CustomSinkOperatorUidHashes customSinkOperatorUidHashes)
String
CustomSinkOperatorUidHashes. getCommitterUidHash()
String
CustomSinkOperatorUidHashes. getGlobalCommitterUidHash()
int
DataStream. getId()
Returns the ID of theDataStream
in the currentStreamExecutionEnvironment
.KeySelector<T,KEY>
KeyedStream. getKeySelector()
Gets the key selector that can get the key by which the stream if partitioned from the elements.TypeInformation<KEY>
KeyedStream. getKeyType()
Gets the type of the key by which the stream is partitioned.LegacySinkTransformation<T>
DataStreamSink. getLegacyTransformation()
Transformation<T>
DataStream. getTransformation()
Returns theTransformation
that represents the operation that logically creates thisDataStream
.Transformation<T>
DataStreamSink. getTransformation()
Returns the transformation that contains the actual sink operator of this sink.String
CustomSinkOperatorUidHashes. getWriterUidHash()
<R> SingleOutputStreamOperator<R>
ConnectedStreams. process(CoProcessFunction<IN1,IN2,R> coProcessFunction, TypeInformation<R> outputType)
Applies the givenCoProcessFunction
on the connected input streams, thereby creating a transformed output stream.<K,R>
SingleOutputStreamOperator<R>ConnectedStreams. process(KeyedCoProcessFunction<K,IN1,IN2,R> keyedCoProcessFunction, TypeInformation<R> outputType)
Applies the givenKeyedCoProcessFunction
on the connected input streams, thereby creating a transformed output stream.<R> SingleOutputStreamOperator<R>
DataStream. process(ProcessFunction<T,R> processFunction, TypeInformation<R> outputType)
Applies the givenProcessFunction
on the input stream, thereby creating a transformed output stream.<R> SingleOutputStreamOperator<R>
KeyedStream. process(KeyedProcessFunction<KEY,T,R> keyedProcessFunction, TypeInformation<R> outputType)
Applies the givenKeyedProcessFunction
on the input stream, thereby creating a transformed output stream.<R> SingleOutputStreamOperator<R>
WindowedStream. process(ProcessWindowFunction<T,R,K,W> function, TypeInformation<R> resultType)
Applies the given window function to each window.<R> SingleOutputStreamOperator<R>
WindowedStream. reduce(ReduceFunction<T> reduceFunction, ProcessWindowFunction<T,R,K,W> function, TypeInformation<R> resultType)
Applies the given window function to each window. -
Uses of Internal in org.apache.flink.streaming.api.environment
Methods in org.apache.flink.streaming.api.environment with annotations of type Internal Modifier and Type Method Description void
StreamExecutionEnvironment. addOperator(Transformation<?> transformation)
Adds an operator to the list of operators that should be executed when callingStreamExecutionEnvironment.execute()
.<OUT> DataStreamSource<OUT>
StreamExecutionEnvironment. addSource(SourceFunction<OUT> function, String sourceName)
Deprecated.This method relies on theSourceFunction
API, which is due to be removed.<OUT> DataStreamSource<OUT>
StreamExecutionEnvironment. addSource(SourceFunction<OUT> function, String sourceName, TypeInformation<OUT> typeInfo)
Deprecated.This method relies on theSourceFunction
API, which is due to be removed.<OUT> DataStreamSource<OUT>
StreamExecutionEnvironment. addSource(SourceFunction<OUT> function, TypeInformation<OUT> typeInfo)
Deprecated.This method relies on theSourceFunction
API, which is due to be removed.static boolean
StreamExecutionEnvironment. areExplicitEnvironmentsAllowed()
Checks whether it is currently permitted to explicitly instantiate a LocalEnvironment or a RemoteEnvironment.<F> F
StreamExecutionEnvironment. clean(F f)
Returns a "closure-cleaned" version of the given function.JobExecutionResult
StreamExecutionEnvironment. execute(StreamGraph streamGraph)
Triggers the program execution.JobClient
StreamExecutionEnvironment. executeAsync(StreamGraph streamGraph)
Triggers the program execution asynchronously.StreamGraph
StreamExecutionEnvironment. generateStreamGraph(List<Transformation<?>> transformations)
Generates aStreamGraph
that consists of the giventransformations
and is configured with the configuration of this environment.ReadableConfig
StreamExecutionEnvironment. getConfiguration()
Gives read-only access to the underlying configuration of this environment.StreamGraph
StreamExecutionEnvironment. getStreamGraph()
Getter of theStreamGraph
of the streaming job.StreamGraph
StreamExecutionEnvironment. getStreamGraph(boolean clearTransformations)
Getter of theStreamGraph
of the streaming job with the option to clear previously registeredtransformations
.List<Transformation<?>>
StreamExecutionEnvironment. getTransformations()
void
StreamExecutionEnvironment. invalidateClusterDataset(AbstractID datasetId)
<T> void
StreamExecutionEnvironment. registerCacheTransformation(AbstractID intermediateDataSetID, CacheTransformation<T> t)
void
StreamExecutionEnvironment. registerCollectIterator(CollectResultIterator<?> iterator)
Configuration
CheckpointConfig. toConfiguration()
Constructors in org.apache.flink.streaming.api.environment with annotations of type Internal Constructor Description CheckpointConfig(Configuration configuration)
-
Uses of Internal in org.apache.flink.streaming.api.functions.aggregation
Classes in org.apache.flink.streaming.api.functions.aggregation with annotations of type Internal Modifier and Type Class Description class
AggregationFunction<T>
Holder class for aggregation types that can be used on a windowed stream or keyed stream.class
ComparableAggregator<T>
AnAggregationFunction
that computes values based on comparisons ofComparables
.class
Comparator
Internal comparator implementation, for use withComparableAggregator
.class
SumAggregator<T>
AnAggregationFunction
that sums up fields.class
SumFunction
Internal function for summing up contents of fields. -
Uses of Internal in org.apache.flink.streaming.api.functions.python
Classes in org.apache.flink.streaming.api.functions.python with annotations of type Internal Modifier and Type Class Description class
DataStreamPythonFunction
DataStreamPythonFunction
maintains the serialized python function which will be used in BeamDataStreamPythonFunctionRunner.class
DataStreamPythonFunctionInfo
DataStreamPythonFunctionInfo
holds a PythonFunction and its function type.class
KeyByKeySelector
KeyByKeySelector
is responsible for extracting the first field of the input row as key.class
PartitionCustomKeySelector
ThePartitionCustomKeySelector
will return the first field of the input row value. -
Uses of Internal in org.apache.flink.streaming.api.functions.python.eventtime
Classes in org.apache.flink.streaming.api.functions.python.eventtime with annotations of type Internal Modifier and Type Class Description class
CustomTimestampAssigner<T>
TimestampAssigner which extracts timestamp from the second field of the input element.class
RemoveTimestampMapFunction<T>
MapFunction which removes the timestamp field from the input element. -
Uses of Internal in org.apache.flink.streaming.api.functions.query
Classes in org.apache.flink.streaming.api.functions.query with annotations of type Internal Modifier and Type Class Description class
QueryableAppendingStateOperator<IN>
Internal operator handling queryable AppendingState instances.class
QueryableValueStateOperator<IN>
Internal operator handling queryable ValueState instances. -
Uses of Internal in org.apache.flink.streaming.api.functions.sink
Classes in org.apache.flink.streaming.api.functions.sink with annotations of type Internal Modifier and Type Class Description class
SinkContextUtil
Utility for creating SinkContexts
. -
Uses of Internal in org.apache.flink.streaming.api.functions.sink.filesystem
Classes in org.apache.flink.streaming.api.functions.sink.filesystem with annotations of type Internal Modifier and Type Class Description class
Bucket<IN,BucketID>
A bucket is the directory organization of the output of theStreamingFileSink
.interface
BucketFactory<IN,BucketID>
A factory able to createbuckets
for theStreamingFileSink
.interface
BucketLifeCycleListener<IN,BucketID>
Listener about the status ofBucket
.class
Buckets<IN,BucketID>
The manager of the different active buckets in theStreamingFileSink
.interface
BucketWriter<IN,BucketID>
An interface for factories that create the differentwriters
.class
BulkBucketWriter<IN,BucketID>
A factory that createsBulkPartWriters
.interface
CompactingFileWriter
The file sink compactors use theCompactingFileWriter
to write a compacting file.static class
CompactingFileWriter.Type
Enum defining the types ofCompactingFileWriter
.class
DefaultBucketFactoryImpl<IN,BucketID>
A factory returningbuckets
.interface
FileLifeCycleListener<BucketID>
Listener about the status of file.class
HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>>
Buckets builder to create buckets that useHadoopPathBasedPartFileWriter
.interface
InProgressFileWriter<IN,BucketID>
TheBucket
uses theInProgressFileWriter
to write element to a part file.interface
OutputStreamBasedCompactingFileWriter
The compactors use theOutputStreamBasedCompactingFileWriter
to directly write a compacting file as anOutputStream
.interface
RecordWiseCompactingFileWriter<IN>
The compactors use theRecordWiseCompactingFileWriter
to write elements to a compacting file.class
RowWiseBucketWriter<IN,BucketID>
A factory that createsRowWisePartWriters
.class
RowWisePartWriter<IN,BucketID>
AInProgressFileWriter
for row-wise formats that use anEncoder
.class
SerializableConfiguration
Wrapper of hadoop Configuration to make it serializable.class
StreamingFileSinkHelper<IN>
Helper forStreamingFileSink
.class
WriterProperties
This class describes the property of theBucketWriter
. -
Uses of Internal in org.apache.flink.streaming.api.functions.sink.filesystem.legacy
Classes in org.apache.flink.streaming.api.functions.sink.filesystem.legacy with annotations of type Internal Modifier and Type Class Description class
StreamingFileSink<IN>
Deprecated.UseFileSink
instead.static class
StreamingFileSink.BucketsBuilder<IN,BucketID,T extends StreamingFileSink.BucketsBuilder<IN,BucketID,T>>
Deprecated.The base abstract class for theStreamingFileSink.RowFormatBuilder
andStreamingFileSink.BulkFormatBuilder
.static class
StreamingFileSink.BulkFormatBuilder<IN,BucketID,T extends StreamingFileSink.BulkFormatBuilder<IN,BucketID,T>>
Deprecated.A builder for configuring the sink for bulk-encoding formats, e.g.static class
StreamingFileSink.DefaultBulkFormatBuilder<IN>
Deprecated.Builder for the vanillaStreamingFileSink
using a bulk format.static class
StreamingFileSink.DefaultRowFormatBuilder<IN>
Deprecated.Builder for the vanillaStreamingFileSink
using a row format.static class
StreamingFileSink.RowFormatBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>>
Deprecated.A builder for configuring the sink for row-wise encoding formats.Methods in org.apache.flink.streaming.api.functions.sink.filesystem.legacy with annotations of type Internal Modifier and Type Method Description abstract Buckets<IN,BucketID>
StreamingFileSink.BucketsBuilder. createBuckets(int subtaskIndex)
Buckets<IN,BucketID>
StreamingFileSink.BulkFormatBuilder. createBuckets(int subtaskIndex)
Buckets<IN,BucketID>
StreamingFileSink.RowFormatBuilder. createBuckets(int subtaskIndex)
abstract BucketWriter<IN,BucketID>
StreamingFileSink.BucketsBuilder. createBucketWriter()
BucketWriter<IN,BucketID>
StreamingFileSink.BulkFormatBuilder. createBucketWriter()
BucketWriter<IN,BucketID>
StreamingFileSink.RowFormatBuilder. createBucketWriter()
static <IN> StreamingFileSink.DefaultBulkFormatBuilder<IN>
StreamingFileSink. forBulkFormat(Path basePath, BulkWriter.Factory<IN> writerFactory)
Deprecated.Creates the builder for aStreamingFileSink
with bulk-encoding format.static <IN> StreamingFileSink.DefaultRowFormatBuilder<IN>
StreamingFileSink. forRowFormat(Path basePath, Encoder<IN> encoder)
Deprecated.Creates the builder for aStreamingFileSink
with row-encoding format. -
Uses of Internal in org.apache.flink.streaming.api.functions.sink.legacy
Classes in org.apache.flink.streaming.api.functions.sink.legacy with annotations of type Internal Modifier and Type Class Description class
DiscardingSink<T>
Deprecated.This interface will be removed in future versions.class
OutputFormatSinkFunction<IN>
Deprecated.Please use theStreamingFileSink
for writing to files from a streaming program.class
PrintSinkFunction<IN>
Deprecated.This interface will be removed in future versions.class
RichSinkFunction<IN>
Deprecated.This interface will be removed in future versions.interface
SinkFunction<IN>
Deprecated.This interface will be removed in future versions.class
SocketClientSink<IN>
Deprecated.This interface will be removed in future versions.class
TwoPhaseCommitSinkFunction<IN,TXN,CONTEXT>
Deprecated.This interface will be removed in future versions.static class
TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>
Deprecated.State POJO class coupling pendingTransaction, context and pendingCommitTransactions.static class
TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>
Deprecated.CustomTypeSerializer
for the sink state.static class
TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>
Deprecated.Snapshot for theTwoPhaseCommitSinkFunction.StateSerializer
.static class
TwoPhaseCommitSinkFunction.TransactionHolder<TXN>
Deprecated.Adds metadata (currently only the start time of the transaction) to the transaction object. -
Uses of Internal in org.apache.flink.streaming.api.functions.source
Classes in org.apache.flink.streaming.api.functions.source with annotations of type Internal Modifier and Type Class Description class
ContinuousFileReaderOperator<OUT,T extends TimestampedInputSplit>
The operator that reads thesplits
received from the precedingContinuousFileMonitoringFunction
. -
Uses of Internal in org.apache.flink.streaming.api.functions.source.datagen
Classes in org.apache.flink.streaming.api.functions.source.datagen with annotations of type Internal Modifier and Type Class Description class
DataGeneratorSource<T>
Deprecated.Useorg.apache.flink.connector.datagen.source.DataGeneratorSource
instead. -
Uses of Internal in org.apache.flink.streaming.api.functions.source.legacy
Classes in org.apache.flink.streaming.api.functions.source.legacy with annotations of type Internal Modifier and Type Class Description class
ContinuousFileMonitoringFunction<OUT>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
FileMonitoringFunction
Deprecated.Internal class deprecated in favour ofContinuousFileMonitoringFunction
.static class
FileMonitoringFunction.WatchType
Deprecated.The watch type of theFileMonitoringFunction
.class
FileReadFunction
Deprecated.Internal class deprecated in favour ofContinuousFileMonitoringFunction
.class
FromElementsFunction<T>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
FromIteratorFunction<T>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
FromSplittableIteratorFunction<T>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
InputFormatSourceFunction<OUT>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.interface
ParallelSourceFunction<OUT>
Deprecated.This interface is based on theSourceFunction
API, which is due to be removed.class
RichParallelSourceFunction<OUT>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
RichSourceFunction<OUT>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
SocketTextStreamFunction
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.interface
SourceFunction<T>
Deprecated.This interface will be removed in future versions.class
StatefulSequenceSource
Deprecated.This class is based on theSourceFunction
API, which is due to be removed. -
Uses of Internal in org.apache.flink.streaming.api.functions.windowing
Classes in org.apache.flink.streaming.api.functions.windowing with annotations of type Internal Modifier and Type Class Description class
AggregateApplyAllWindowFunction<W extends Window,T,ACC,V,R>
class
AggregateApplyWindowFunction<K,W extends Window,T,ACC,V,R>
class
InternalProcessApplyAllWindowContext<IN,OUT,W extends Window>
Internal reusable context wrapper.class
InternalProcessApplyWindowContext<IN,OUT,KEY,W extends Window>
Internal reusable context wrapper.class
PassThroughAllWindowFunction<W extends Window,T>
AAllWindowFunction
that just emits each input element.class
PassThroughWindowFunction<K,W extends Window,T>
AWindowFunction
that just emits each input element.class
ReduceApplyAllWindowFunction<W extends Window,T,R>
InternalAllWindowFunction
that is used for implementing a fold on a window configuration that only allowsAllWindowFunction
and cannot directly execute aReduceFunction
.class
ReduceApplyProcessAllWindowFunction<W extends Window,T,R>
InternalProcessAllWindowFunction
that is used for implementing a fold on a window configuration that only allowsAllWindowFunction
and cannot directly execute aReduceFunction
.class
ReduceApplyProcessWindowFunction<K,W extends Window,T,R>
InternalProcessWindowFunction
that is used for implementing a fold on a window configuration that only allowsAllWindowFunction
and cannot directly execute aReduceFunction
.class
ReduceApplyWindowFunction<K,W extends Window,T,R>
InternalWindowFunction
that is used for implementing a fold on a window configuration that only allowsWindowFunction
and cannot directly execute aReduceFunction
. -
Uses of Internal in org.apache.flink.streaming.api.functions.windowing.delta.extractor
Classes in org.apache.flink.streaming.api.functions.windowing.delta.extractor with annotations of type Internal Modifier and Type Class Description class
ArrayFromTuple
Converts a Tuple to an Object-Array.class
ConcatenatedExtract<FROM,OVER,TO>
Combines two extractors which will be executed one after each other.interface
Extractor<FROM,TO>
Extractors allow to extract/convert one type to another.class
FieldFromArray<OUT>
Extracts a single field out of an array.class
FieldFromTuple<OUT>
Extracts a single field out of a tuple.class
FieldsFromArray<OUT>
Extracts multiple fields from an array and puts them into a new array of the specified type.class
FieldsFromTuple
Extracts one or more fields of the type Double from a tuple and puts them into a new double[]. -
Uses of Internal in org.apache.flink.streaming.api.graph
Classes in org.apache.flink.streaming.api.graph with annotations of type Internal Modifier and Type Interface Description interface
ExecutionPlan
An interface representing a general execution plan, which can be implemented by different types of graphs such as JobGraph and StreamGraph.class
GlobalStreamExchangeMode
This mode decides the defaultResultPartitionType
of job edges.class
JSONGenerator
Helper class for generating a JSON representation from aStreamGraph
.class
NonChainedOutput
Used by operator chain and represents a non-chained output of the corresponding stream operator.class
SimpleTransformationTranslator<OUT,T extends Transformation<OUT>>
A base class for allTransformationTranslators
who translateTransformations
that have a single operator in their runtime implementation.class
StreamConfig
Internal configuration for aStreamOperator
.class
StreamEdge
An edge in the streaming topology.class
StreamGraph
Class representing the streaming topology.class
StreamGraphGenerator
A generator that generates aStreamGraph
from a graph ofTransformation
s.class
StreamingJobGraphGenerator
The StreamingJobGraphGenerator converts aStreamGraph
into aJobGraph
.class
StreamNode
Class representing the operators in the streaming programs, with all their properties.interface
TransformationTranslator<OUT,T extends Transformation<OUT>>
ATransformationTranslator
is responsible for translating a givenTransformation
to its runtime implementation depending on the execution mode.static interface
TransformationTranslator.Context
A context giving the necessary information for the translation of a given transformation. -
Uses of Internal in org.apache.flink.streaming.api.graph.util
Classes in org.apache.flink.streaming.api.graph.util with annotations of type Internal Modifier and Type Class Description class
ChainedOperatorHashInfo
Helper class to help maintain the hash info of an operator chain.class
ChainedSourceInfo
Helper class to help maintain the chained source info of an operator chain.class
JobVertexBuildContext
Helper class encapsulates all necessary information and configurations required during the construction of job vertices.class
OperatorChainInfo
Helper class to help maintain the information of an operator chain.class
OperatorInfo
Helper class to help maintain the information of an operator. -
Uses of Internal in org.apache.flink.streaming.api.lineage
Classes in org.apache.flink.streaming.api.lineage with annotations of type Internal Modifier and Type Class Description class
DefaultLineageDataset
Default implementation forLineageDataset
.class
DefaultLineageEdge
Implementation of LineageEdge.class
DefaultLineageGraph
Default implementation forLineageGraph
.static class
DefaultLineageGraph.LineageGraphBuilder
Build the default lineage graph fromLineageEdge
.class
DefaultLineageVertex
Default implementation forLineageVertex
.class
DefaultSourceLineageVertex
Default implementation forSourceLineageVertex
.class
LineageGraphUtils
Utils for building lineage graph from transformations. -
Uses of Internal in org.apache.flink.streaming.api.operators
Classes in org.apache.flink.streaming.api.operators with annotations of type Internal Modifier and Type Class Description class
BatchGroupedReduceOperator<IN,KEY>
AStreamOperator
for executing aReduceFunction
on aKeyedStream
in aRuntimeExecutionMode.BATCH
mode.interface
CoordinatedOperatorFactory<OUT>
A factory class for theStreamOperator
s implementingOperatorEventHandler
.interface
InputFormatOperatorFactory<OUT>
Input format source operator factory.interface
InternalTimer<K,N>
Internal interface for in-flight timers.interface
InternalTimerService<N>
Interface for working with time and timers.class
InternalTimerServiceAsyncImpl<K,N>
An implementation ofInternalTimerService
that is used byorg.apache.flink.streaming.runtime.operators.asyncprocessing.AbstractAsyncStateStreamOperator
.class
InternalTimerServiceSerializationProxy<K>
Serialization proxy for the timer services for a given key-group.class
InternalTimersSnapshotReaderWriters
Readers and writers for different versions of theInternalTimersSnapshot
.interface
InternalTimeServiceManager<K>
An entity keeping all the time-related services.static interface
InternalTimeServiceManager.ShouldStopAdvancingFn
Signals whether the watermark should continue advancing.class
InternalTimeServiceManagerImpl<K>
An entity keeping all the time-related services.interface
KeyContextHandler
This interface is used to optimize the calls ofInput.setKeyContextElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN>)
,StreamOperator.setKeyContextElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<?>)
andStreamOperator.setKeyContextElement2(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<?>)
.class
KeyedProcessOperator<K,IN,OUT>
AStreamOperator
for executingKeyedProcessFunctions
.class
LegacyKeyedProcessOperator<K,IN,OUT>
Deprecated.Replaced byKeyedProcessOperator
which takesKeyedProcessFunction
class
MailboxWatermarkProcessor<OUT>
A helper class to let operators emit watermarks incrementally from mailbox.class
MapPartitionIterator<IN>
TheMapPartitionIterator
is an iterator used in theMapPartitionOperator
.The task main thread will add records to it.class
MapPartitionOperator<IN,OUT>
TheMapPartitionOperator
is used to process all records in each partition on non-keyed stream.interface
OnWatermarkCallback<KEY>
A callback registered with theInternalWatermarkCallbackService
service.interface
OutputFormatOperatorFactory<IN,OUT>
Interface for operator factories which create the sink operator containing anOutputFormat
.class
PartitionAggregateOperator<IN,ACC,OUT>
ThePartitionAggregateOperator
is used to apply the aggregate transformation on all records of each partition.class
PartitionReduceOperator<IN>
ThePartitionReduceOperator
is used to apply the reduce transformation on all records of each partition.class
ProcessOperator<IN,OUT>
AStreamOperator
for executingProcessFunctions
.class
SimpleInputFormatOperatorFactory<OUT>
Input format source operator factory which just wrap existedStreamSource
.class
SimpleOperatorFactory<OUT>
Simple factory which just wrap existedStreamOperator
.class
SimpleOutputFormatOperatorFactory<IN,OUT>
A simple operator factory which create an operator containing anOutputFormat
.class
SimpleUdfStreamOperatorFactory<OUT>
Udf stream operator factory which just wrap existedAbstractUdfStreamOperator
.class
SourceOperator<OUT,SplitT extends SourceSplit>
Base source operator only used for integrating the source reader which is proposed by FLIP-27.class
StreamFilter<IN>
AStreamOperator
for executingFilterFunctions
.class
StreamFlatMap<IN,OUT>
AStreamOperator
for executingFlatMapFunctions
.class
StreamGroupedReduceOperator<IN>
class
StreamingRuntimeContext
Implementation of theRuntimeContext
, for streaming operators.class
StreamMap<IN,OUT>
AStreamOperator
for executingMapFunctions
.class
StreamOperatorStateHandler
Class encapsulating various state backend handling logic forStreamOperator
implementations.class
StreamOperatorUtils
class
StreamProject<IN,OUT extends Tuple>
AStreamOperator
for executing projections on streams.class
StreamSink<IN>
AStreamOperator
for executingSinkFunctions
.class
StreamSource<OUT,SRC extends SourceFunction<OUT>>
Deprecated.This class is based on theSourceFunction
API, which is due to be removed.class
TimerHeapInternalTimer<K,N>
Implementation ofInternalTimer
to use with aHeapPriorityQueueSet
.class
TimerSerializer<K,N>
A serializer forTimerHeapInternalTimer
objects that produces a serialization format that is lexicographically aligned the priority of the timers.class
TimerSerializerSnapshot<K,N>
Snapshot class for theTimerSerializer
.class
TimestampedCollector<T>
interface
Triggerable<K,N>
Interface for things that can be called byInternalTimerService
.interface
UdfStreamOperatorFactory<OUT>
Udf stream operator factory.interface
UserFunctionProvider<F extends Function>
The interface with user function.interface
YieldingOperator<OUT>
A V1 operator that needs access to theMailboxExecutor
should implement this interface.Methods in org.apache.flink.streaming.api.operators with annotations of type Internal Modifier and Type Method Description ThrowingConsumer<StreamRecord<IN>,Exception>
AbstractInput. getRecordProcessor(int inputId)
boolean
AbstractStreamOperator. hasKeyContext1()
boolean
AbstractStreamOperator. hasKeyContext2()
boolean
AbstractInput. isAsyncStateProcessingEnabled()
boolean
AbstractStreamOperator. isAsyncStateProcessingEnabled()
Indicates whether this operator is enabling the async state.boolean
AbstractStreamOperatorV2. isAsyncStateProcessingEnabled()
Indicates whether this operator is enabling the async state.protected boolean
AbstractStreamOperator. isUsingCustomRawKeyedState()
Indicates whether or not implementations of this class is writing to the raw keyed state streams on snapshots, usingAbstractStreamOperator.snapshotState(StateSnapshotContext)
.protected boolean
AbstractStreamOperatorV2. isUsingCustomRawKeyedState()
Indicates whether or not implementations of this class is writing to the raw keyed state streams on snapshots, usingAbstractStreamOperatorV2.snapshotState(StateSnapshotContext)
.void
AbstractStreamOperator. setMailboxExecutor(MailboxExecutor mailboxExecutor)
boolean
AbstractStreamOperator. useSplittableTimers()
Can be overridden to disable splittable timers for this particular operator even if config option is enabled.boolean
AbstractStreamOperatorV2. useSplittableTimers()
Can be overridden to disable splittable timers for this particular operator even if config option is enabled. -
Uses of Internal in org.apache.flink.streaming.api.operators.async
Classes in org.apache.flink.streaming.api.operators.async with annotations of type Internal Modifier and Type Class Description class
AsyncWaitOperator<IN,OUT>
TheAsyncWaitOperator
allows to asynchronously process incoming stream records. -
Uses of Internal in org.apache.flink.streaming.api.operators.async.queue
Classes in org.apache.flink.streaming.api.operators.async.queue with annotations of type Internal Modifier and Type Class Description class
OrderedStreamElementQueue<OUT>
OrderedStreamElementQueue
implementation.interface
StreamElementQueue<OUT>
Interface for stream element queues for theAsyncWaitOperator
.class
UnorderedStreamElementQueue<OUT>
Unordered implementation of theStreamElementQueue
. -
Uses of Internal in org.apache.flink.streaming.api.operators.co
-
Uses of Internal in org.apache.flink.streaming.api.operators.collect
Classes in org.apache.flink.streaming.api.operators.collect with annotations of type Internal Modifier and Type Class Description class
ClientAndIterator<E>
class
CollectSinkFunction<IN>
A sink function that collects query results and sends them back to the client.class
CollectStreamSink<T>
ADataStreamSink
which is used to collect results of a data stream. -
Uses of Internal in org.apache.flink.streaming.api.operators.legacy
Classes in org.apache.flink.streaming.api.operators.legacy with annotations of type Internal Modifier and Type Interface Description interface
YieldingOperatorFactory<OUT>
Deprecated. -
Uses of Internal in org.apache.flink.streaming.api.operators.python
Classes in org.apache.flink.streaming.api.operators.python with annotations of type Internal Modifier and Type Class Description class
AbstractPythonFunctionOperator<OUT>
Base class for all stream operators to execute Python functions.interface
DataStreamPythonFunctionOperator<OUT>
Interface for Python DataStream operators. -
Uses of Internal in org.apache.flink.streaming.api.operators.python.embedded
Classes in org.apache.flink.streaming.api.operators.python.embedded with annotations of type Internal Modifier and Type Class Description class
AbstractEmbeddedDataStreamPythonFunctionOperator<OUT>
Base class for all Python DataStream operators executed in embedded Python environment.class
AbstractEmbeddedPythonFunctionOperator<OUT>
Abstract class for all stream operators to execute Python functions in embedded Python environment.class
AbstractOneInputEmbeddedPythonFunctionOperator<IN,OUT>
AbstractOneInputEmbeddedPythonFunctionOperator
is responsible for run Python DataStream operators with one input in Embedded Python environment.class
AbstractTwoInputEmbeddedPythonFunctionOperator<IN1,IN2,OUT>
AbstractTwoInputEmbeddedPythonFunctionOperator
is responsible for run Python DataStream operators with two input user defined python function in Embedded Python environment.class
EmbeddedPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>
TheEmbeddedPythonBatchCoBroadcastProcessOperator
is responsible for executing the Python CoBroadcastProcess Function under BATCH mode,EmbeddedPythonCoProcessOperator
is used under STREAMING mode.class
EmbeddedPythonBatchKeyedCoBroadcastProcessOperator<K,IN1,IN2,OUT>
TheEmbeddedPythonBatchKeyedCoBroadcastProcessOperator
is responsible for executing the Python CoBroadcastProcess function under BATCH mode,EmbeddedPythonKeyedCoProcessOperator
is used under STREAMING mode.class
EmbeddedPythonCoProcessOperator<IN1,IN2,OUT>
EmbeddedPythonCoProcessOperator
is responsible for executing Python CoProcessFunction in embedded Python environment.class
EmbeddedPythonKeyedCoProcessOperator<K,IN1,IN2,OUT>
EmbeddedPythonKeyedCoProcessOperator
is responsible for executing user defined python KeyedCoProcessFunction in embedded Python environment.class
EmbeddedPythonKeyedProcessOperator<K,IN,OUT>
EmbeddedPythonKeyedProcessOperator
is responsible for executing user defined python KeyedProcessFunction in embedded Python environment.class
EmbeddedPythonProcessOperator<IN,OUT>
EmbeddedPythonProcessOperator
is responsible for executing Python ProcessFunction in embedded Python environment.class
EmbeddedPythonWindowOperator<K,IN,OUT,W extends Window>
EmbeddedPythonWindowOperator
is responsible for executing user defined python ProcessWindowFunction in embedded Python environment. -
Uses of Internal in org.apache.flink.streaming.api.operators.python.process
Classes in org.apache.flink.streaming.api.operators.python.process with annotations of type Internal Modifier and Type Class Description class
AbstractExternalDataStreamPythonFunctionOperator<OUT>
Base class for all Python DataStream operators executed in Python process.class
AbstractExternalOneInputPythonFunctionOperator<IN,OUT>
AbstractExternalOneInputPythonFunctionOperator
is responsible for launching beam runner which will start a python harness to execute user defined python function.class
AbstractExternalPythonFunctionOperator<OUT>
Abstract class for all stream operators to execute Python functions in external environment.class
AbstractExternalTwoInputPythonFunctionOperator<IN1,IN2,OUT>
AbstractExternalTwoInputPythonFunctionOperator
is responsible for launching beam runner which will start a python harness to execute two-input user defined python function.class
ExternalPythonBatchCoBroadcastProcessOperator<IN1,IN2,OUT>
TheExternalPythonBatchCoBroadcastProcessOperator
is responsible for executing the Python CoBroadcastProcess Function under BATCH mode,ExternalPythonCoProcessOperator
is used under STREAMING mode.class
ExternalPythonBatchKeyedCoBroadcastProcessOperator<OUT>
TheExternalPythonBatchKeyedCoBroadcastProcessOperator
is responsible for executing the Python CoBroadcastProcess function under BATCH mode,ExternalPythonKeyedCoProcessOperator
is used under STREAMING mode.class
ExternalPythonCoProcessOperator<IN1,IN2,OUT>
TheExternalPythonCoProcessOperator
is responsible for executing the Python CoProcess Function.class
ExternalPythonKeyedCoProcessOperator<OUT>
ExternalPythonKeyedCoProcessOperator
is responsible for launching beam runner which will start a python harness to execute user defined python CoProcess function.class
ExternalPythonKeyedProcessOperator<OUT>
ExternalPythonKeyedProcessOperator
is responsible for launching beam runner which will start a python harness to execute user defined python function.class
ExternalPythonProcessOperator<IN,OUT>
ExternalPythonProcessOperator
is responsible for launching beam runner which will start a python harness to execute user defined python ProcessFunction. -
Uses of Internal in org.apache.flink.streaming.api.operators.python.process.collector
Classes in org.apache.flink.streaming.api.operators.python.process.collector with annotations of type Internal Modifier and Type Class Description class
RunnerOutputCollector<OUT>
Output collector for Python UDF runner. -
Uses of Internal in org.apache.flink.streaming.api.operators.python.process.timer
Classes in org.apache.flink.streaming.api.operators.python.process.timer with annotations of type Internal Modifier and Type Class Description class
TimerHandler
Utilities to handle triggered timer.class
TimerRegistration
Handles the interaction with the Python worker for registering and deleting timers.class
TimerUtils
Utilities for timer. -
Uses of Internal in org.apache.flink.streaming.api.operators.sortpartition
Classes in org.apache.flink.streaming.api.operators.sortpartition with annotations of type Internal Modifier and Type Class Description class
FixedLengthByteKeyAndValueComparator<INPUT>
TheFixedLengthByteKeyAndValueComparator
is used byKeyedSortPartitionOperator
to compare records according to both the record key and record value.class
KeyedSortPartitionOperator<INPUT,KEY>
TheKeyedSortPartitionOperator
sorts records of a partition onKeyedStream
.class
SortPartitionOperator<INPUT>
TheSortPartitionOperator
sorts records of a partition on non-keyed data stream.class
VariableLengthByteKeyAndValueComparator<INPUT>
TheVariableLengthByteKeyAndValueComparator
is used byKeyedSortPartitionOperator
to compare records according to both the record key and record value. -
Uses of Internal in org.apache.flink.streaming.api.operators.source
Classes in org.apache.flink.streaming.api.operators.source with annotations of type Internal Modifier and Type Class Description class
NoOpTimestampsAndWatermarks<T>
An implementation ofTimestampsAndWatermarks
where all watermarking/event-time operations are no-ops.class
ProgressiveTimestampsAndWatermarks<T>
An implementation ofTimestampsAndWatermarks
that does periodic watermark emission and keeps track of watermarks on a per-split basis.class
SourceOutputWithWatermarks<T>
Implementation of the SourceOutput.interface
TimestampsAndWatermarks<T>
Basic interface for the timestamp extraction and watermark generation logic for theSourceReader
.static class
TimestampsAndWatermarks.TimestampsAndWatermarksContextProvider
static interface
TimestampsAndWatermarks.WatermarkUpdateListener
Lets the owner/creator of the output know about latest emitted watermark.class
TimestampsAndWatermarksContext
A simple implementation of a context that is bothTimestampAssignerSupplier.Context
andWatermarkGeneratorSupplier.Context
.class
WatermarkToDataOutput
An adapter that exposes aWatermarkOutput
based on aPushingAsyncDataInput.DataOutput
. -
Uses of Internal in org.apache.flink.streaming.api.operators.util
Classes in org.apache.flink.streaming.api.operators.util with annotations of type Internal Modifier and Type Class Description class
PausableRelativeClock
ARelativeClock
whose time progress with respect to the wall clock can be paused and un-paused. -
Uses of Internal in org.apache.flink.streaming.api.runners.python.beam
Classes in org.apache.flink.streaming.api.runners.python.beam with annotations of type Internal Modifier and Type Class Description class
BeamDataStreamPythonFunctionRunner
BeamDataStreamPythonFunctionRunner
is responsible for starting a beam python harness to execute user defined python function.class
BeamPythonFunctionRunner
ABeamPythonFunctionRunner
used to execute Python functions.class
PythonSharedResources
The set of resources that can be shared by all the Python operators in a slot. -
Uses of Internal in org.apache.flink.streaming.api.transformations
Classes in org.apache.flink.streaming.api.transformations with annotations of type Internal Modifier and Type Class Description class
AbstractBroadcastStateTransformation<IN1,IN2,OUT>
Base class for Broadcast State transformations.class
AbstractMultipleInputTransformation<OUT>
Base class for transformations representing the application of aMultipleInputStreamOperator
to inputTransformations
.class
BroadcastStateTransformation<IN1,IN2,OUT>
A non-keyedAbstractBroadcastStateTransformation
.class
CacheTransformation<T>
When in batch mode, theCacheTransformation
represents the intermediate result of the upper stream should be cached when it is computed at the first time.class
DataStreamV2SinkTransformation<InputT,OutputT>
TheTransformation
for DataStream V2 based sink.class
GlobalCommitterTransform<CommT>
Transformation for global committer.class
KeyedBroadcastStateTransformation<KEY,IN1,IN2,OUT>
A keyedAbstractBroadcastStateTransformation
.class
KeyedMultipleInputTransformation<OUT>
AbstractMultipleInputTransformation
implementation for keyed streams.class
LegacySinkTransformation<T>
This Transformation represents a stream Sink.class
LegacySourceTransformation<T>
This represents a Source.class
MultipleInputTransformation<OUT>
AbstractMultipleInputTransformation
implementation for non-keyed streams.class
OneInputTransformation<IN,OUT>
This Transformation represents the application of aOneInputStreamOperator
to one inputTransformation
.class
PartitionTransformation<T>
This transformation represents a change of partitioning of the input elements.class
PhysicalTransformation<T>
ATransformation
that creates a physical operation.class
ReduceTransformation<IN,K>
ATransformation
that describes a reduce operation on aKeyedStream
.class
SinkTransformation<InputT,OutputT>
ATransformation
forSink
.class
SourceTransformation<OUT,SplitT extends SourceSplit,EnumChkT>
APhysicalTransformation
forSource
.class
SourceTransformationWrapper<T>
This Transformation is a phantom transformation which is used to expose a default parallelism to downstream.class
StreamExchangeMode
The data exchange mode between operators duringStreamGraph
generation.class
TimestampsAndWatermarksTransformation<IN>
class
TransformationWithLineage<T>
ATransformation
that contains lineage information.class
TwoInputTransformation<IN1,IN2,OUT>
This Transformation represents the application of aTwoInputStreamOperator
to two inputTransformations
.class
UnionTransformation<T>
This transformation represents a union of several inputTransformations
.interface
WithBoundedness
An interface to be implemented by transformations that have explicitly setBoundedness
. -
Uses of Internal in org.apache.flink.streaming.api.transformations.python
Classes in org.apache.flink.streaming.api.transformations.python with annotations of type Internal Modifier and Type Class Description class
PythonBroadcastStateTransformation<IN1,IN2,OUT>
ATransformation
representing a Python Co-Broadcast-Process operation, which will be translated into different operations byPythonBroadcastStateTransformationTranslator
.class
PythonKeyedBroadcastStateTransformation<OUT>
ATransformation
representing a Python Keyed-Co-Broadcast-Process operation, which will be translated into different operations byPythonKeyedBroadcastStateTransformationTranslator
. -
Uses of Internal in org.apache.flink.streaming.api.typeinfo.python
Classes in org.apache.flink.streaming.api.typeinfo.python with annotations of type Internal Modifier and Type Class Description class
PickledByteArrayTypeInfo
A PickledByteArrayTypeInfo indicates that the data of this type is a generated primitive byte array by pickle. -
Uses of Internal in org.apache.flink.streaming.api.utils
Classes in org.apache.flink.streaming.api.utils with annotations of type Internal Modifier and Type Class Description class
ByteArrayWrapper
A wrapper of the byte array.class
ByteArrayWrapperSerializer
The serializer ofByteArrayWrapper
.class
PythonOperatorUtils
Utilities used by Python operators.class
PythonTypeUtils
A util class for converting the given TypeInformation to other objects. -
Uses of Internal in org.apache.flink.streaming.api.watermark
Classes in org.apache.flink.streaming.api.watermark with annotations of type Internal Modifier and Type Class Description class
InternalWatermark
TheWatermark
that contains extra information to be used internally. -
Uses of Internal in org.apache.flink.streaming.api.windowing.assigners
Classes in org.apache.flink.streaming.api.windowing.assigners with annotations of type Internal Modifier and Type Class Description static class
GlobalWindows.EndOfStreamTrigger
A trigger that fires iff the input stream reaches EndOfStream.static class
GlobalWindows.NeverTrigger
A trigger that never fires, as default Trigger for GlobalWindows. -
Uses of Internal in org.apache.flink.streaming.runtime.execution
Classes in org.apache.flink.streaming.runtime.execution with annotations of type Internal Modifier and Type Class Description class
DefaultJobCreatedEvent
Default implementation forJobCreatedEvent
. -
Uses of Internal in org.apache.flink.streaming.runtime.io
Classes in org.apache.flink.streaming.runtime.io with annotations of type Internal Modifier and Type Class Description class
BlockingQueueBroker
Broker
for theBlockingQueue
used inStreamIterationHead
andStreamIterationTail
for implementing feedback streams.class
DataInputStatus
It is an internal equivalent ofInputStatus
that provides additional non public statuses.class
InputGateUtil
Utility for dealing with input gates.class
MultipleFuturesAvailabilityHelper
This class is semi-thread safe.class
MultipleInputSelectionHandler
This handler is mainly used for selecting the next available input index inStreamMultipleInputProcessor
.interface
PushingAsyncDataInput<T>
The variant ofPullingAsyncDataInput
that is defined for handling both network input and source input in a unified way viaPushingAsyncDataInput.emitNext(DataOutput)
instead of returningOptional.empty()
viaPullingAsyncDataInput.pollNext()
.class
RecordWriterOutput<OUT>
-