Modifier and Type | Method and Description |
---|---|
static PartitionCommitTrigger |
PartitionCommitTrigger.create(boolean isRestored,
OperatorStateStore stateStore,
Configuration conf,
ClassLoader cl,
List<String> partitionKeys,
ProcessingTimeService procTimeService) |
Constructor and Description |
---|
ProcTimeCommitTrigger(boolean isRestored,
OperatorStateStore stateStore,
ProcessingTimeService procTimeService,
PartitionCommitPredicate partitionCommitPredicate) |
Modifier and Type | Class and Description |
---|---|
class |
NeverFireProcessingTimeService
A processing time service whose timers never fire so all timers are included in savepoints.
|
Constructor and Description |
---|
StreamingFileSinkHelper(Buckets<IN,?> buckets,
boolean isRestored,
OperatorStateStore stateStore,
ProcessingTimeService procTimeService,
long bucketCheckInterval) |
Modifier and Type | Field and Description |
---|---|
protected ProcessingTimeService |
AbstractStreamOperatorV2.processingTimeService |
protected ProcessingTimeService |
AbstractStreamOperator.processingTimeService |
protected ProcessingTimeService |
AbstractStreamOperatorFactory.processingTimeService |
Modifier and Type | Method and Description |
---|---|
ProcessingTimeService |
StreamingRuntimeContext.getProcessingTimeService() |
ProcessingTimeService |
AbstractStreamOperatorV2.getProcessingTimeService()
Returns the
ProcessingTimeService responsible for getting the current processing time
and registering timers. |
ProcessingTimeService |
StreamOperatorParameters.getProcessingTimeService() |
ProcessingTimeService |
AbstractStreamOperator.getProcessingTimeService()
Returns the
ProcessingTimeService responsible for getting the current processing time
and registering timers. |
Modifier and Type | Method and Description |
---|---|
static <OUT,OP extends StreamOperator<OUT>> |
StreamOperatorFactoryUtil.createOperator(StreamOperatorFactory<OUT> operatorFactory,
StreamTask<OUT,?> containingTask,
StreamConfig configuration,
Output<StreamRecord<OUT>> output,
OperatorEventDispatcher operatorEventDispatcher)
Creates a new operator using a factory and makes sure that all special factory traits are
properly handled.
|
Modifier and Type | Method and Description |
---|---|
<K> InternalTimeServiceManager<K> |
InternalTimeServiceManager.Provider.create(CheckpointableKeyedStateBackend<K> keyedStatedBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<KeyGroupStatePartitionStreamProvider> rawKeyedStates) |
static <K> InternalTimeServiceManagerImpl<K> |
InternalTimeServiceManagerImpl.create(CheckpointableKeyedStateBackend<K> keyedStateBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<KeyGroupStatePartitionStreamProvider> rawKeyedStates)
A factory method for creating the
InternalTimeServiceManagerImpl . |
static <OUT> SourceFunction.SourceContext<OUT> |
StreamSourceContexts.getSourceContext(TimeCharacteristic timeCharacteristic,
ProcessingTimeService processingTimeService,
Object checkpointLock,
Output<StreamRecord<OUT>> output,
long watermarkInterval,
long idleTimeout,
boolean emitProgressiveWatermarks)
Depending on the
TimeCharacteristic , this method will return the adequate SourceFunction.SourceContext . |
void |
AbstractStreamOperator.setProcessingTimeService(ProcessingTimeService processingTimeService)
Deprecated.
The
ProcessingTimeService instance should be passed by the operator
constructor and this method will be removed along with SetupableStreamOperator . |
void |
AbstractStreamOperatorFactory.setProcessingTimeService(ProcessingTimeService processingTimeService) |
StreamOperatorStateContext |
StreamTaskStateInitializerImpl.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup,
double managedMemoryFraction,
boolean isUsingCustomRawKeyedState) |
StreamOperatorStateContext |
StreamTaskStateInitializer.streamOperatorStateContext(OperatorID operatorID,
String operatorClassName,
ProcessingTimeService processingTimeService,
KeyContext keyContext,
TypeSerializer<?> keySerializer,
CloseableRegistry streamTaskCloseableRegistry,
MetricGroup metricGroup,
double managedMemoryFraction,
boolean isUsingCustomRawKeyedState)
Returns the
StreamOperatorStateContext for an AbstractStreamOperator that
runs in the stream task that owns this manager. |
Constructor and Description |
---|
SourceOperator(FunctionWithException<SourceReaderContext,SourceReader<OUT,SplitT>,Exception> readerFactory,
OperatorEventGateway operatorEventGateway,
SimpleVersionedSerializer<SplitT> splitSerializer,
WatermarkStrategy<OUT> watermarkStrategy,
ProcessingTimeService timeService,
Configuration configuration,
String localHostname,
boolean emitProgressiveWatermarks) |
StreamingRuntimeContext(Environment env,
Map<String,Accumulator<?,?>> accumulators,
OperatorMetricGroup operatorMetricGroup,
OperatorID operatorID,
ProcessingTimeService processingTimeService,
KeyedStateStore keyedStateStore,
ExternalResourceInfoProvider externalResourceInfoProvider) |
Constructor and Description |
---|
StreamOperatorParameters(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output,
java.util.function.Supplier<ProcessingTimeService> processingTimeServiceFactory,
OperatorEventDispatcher operatorEventDispatcher) |
Constructor and Description |
---|
AsyncWaitOperator(AsyncFunction<IN,OUT> asyncFunction,
long timeout,
int capacity,
AsyncDataStream.OutputMode outputMode,
AsyncRetryStrategy<OUT> asyncRetryStrategy,
ProcessingTimeService processingTimeService,
MailboxExecutor mailboxExecutor) |
Modifier and Type | Method and Description |
---|---|
static <K> InternalTimeServiceManager<K> |
BatchExecutionInternalTimeServiceManager.create(CheckpointableKeyedStateBackend<K> keyedStatedBackend,
ClassLoader userClassloader,
KeyContext keyContext,
ProcessingTimeService processingTimeService,
Iterable<KeyGroupStatePartitionStreamProvider> rawKeyedStates) |
Constructor and Description |
---|
BatchExecutionInternalTimeServiceManager(ProcessingTimeService processingTimeService) |
Modifier and Type | Method and Description |
---|---|
static <E> TimestampsAndWatermarks<E> |
TimestampsAndWatermarks.createProgressiveEventTimeLogic(WatermarkStrategy<E> watermarkStrategy,
MetricGroup metrics,
ProcessingTimeService timeService,
long periodicWatermarkIntervalMillis) |
Constructor and Description |
---|
ProgressiveTimestampsAndWatermarks(TimestampAssigner<T> timestampAssigner,
WatermarkGeneratorSupplier<T> watermarksFactory,
WatermarkGeneratorSupplier.Context watermarksContext,
ProcessingTimeService timeService,
java.time.Duration periodicWatermarkInterval) |
Constructor and Description |
---|
AbstractFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> seedPartitionsWithInitialOffsets,
SerializedValue<WatermarkStrategy<T>> watermarkStrategy,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
KafkaFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<WatermarkStrategy<T>> watermarkStrategy,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
KafkaShuffleFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<WatermarkStrategy<T>> watermarkStrategy,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KafkaDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics,
TypeSerializer<T> typeSerializer,
int producerParallelism) |
Modifier and Type | Interface and Description |
---|---|
interface |
TimerService
A common timer service interface with life cycle methods.
|
Modifier and Type | Class and Description |
---|---|
class |
SystemProcessingTimeService
A
TimerService which assigns as current processing time the result of calling System.currentTimeMillis() and registers timers using a ScheduledThreadPoolExecutor . |
class |
TestProcessingTimeService
This is a
TimerService and ProcessingTimeService used strictly for testing
the processing time functionality. |
Modifier and Type | Method and Description |
---|---|
ProcessingTimeService |
ProcessingTimeServiceFactory.createProcessingTimeService(MailboxExecutor mailboxExecutor)
Creates a new processing time service with the mailbox executor.
|
Modifier and Type | Method and Description |
---|---|
void |
ProcessingTimeServiceAware.setProcessingTimeService(ProcessingTimeService processingTimeService) |
Modifier and Type | Field and Description |
---|---|
protected ProcessingTimeService |
TableStreamOperator.ContextImpl.timerService |
Constructor and Description |
---|
WatermarkAssignerOperator(int rowtimeFieldIndex,
WatermarkGenerator watermarkGenerator,
long idleTimeout,
ProcessingTimeService processingTimeService)
Create a watermark assigner operator.
|
Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.