Modifier and Type | Method and Description |
---|---|
void |
SpoutWrapper.run(SourceFunction.SourceContext<OUT> ctx) |
Modifier and Type | Method and Description |
---|---|
void |
StatefulSequenceSource.run(SourceFunction.SourceContext<Long> ctx) |
void |
InputFormatSourceFunction.run(SourceFunction.SourceContext<OUT> ctx) |
void |
SocketTextStreamFunction.run(SourceFunction.SourceContext<String> ctx) |
void |
FromElementsFunction.run(SourceFunction.SourceContext<T> ctx) |
void |
SourceFunction.run(SourceFunction.SourceContext<T> ctx)
Starts the source.
|
void |
FromIteratorFunction.run(SourceFunction.SourceContext<T> ctx) |
void |
FromSplittableIteratorFunction.run(SourceFunction.SourceContext<T> ctx) |
void |
ContinuousFileMonitoringFunction.run(SourceFunction.SourceContext<TimestampedFileInputSplit> context) |
void |
FileMonitoringFunction.run(SourceFunction.SourceContext<Tuple3<String,Long,Long>> ctx)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
static <OUT> SourceFunction.SourceContext<OUT> |
StreamSourceContexts.getSourceContext(TimeCharacteristic timeCharacteristic,
ProcessingTimeService processingTimeService,
Object checkpointLock,
StreamStatusMaintainer streamStatusMaintainer,
Output<StreamRecord<OUT>> output,
long watermarkInterval,
long idleTimeout)
Depending on the
TimeCharacteristic , this method will return the adequate
SourceFunction.SourceContext . |
Modifier and Type | Method and Description |
---|---|
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer010.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer09.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected AbstractFetcher<T,?> |
FlinkKafkaConsumer08.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
protected abstract AbstractFetcher<T,?> |
FlinkKafkaConsumerBase.createFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> subscribedPartitionsToStartOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
OffsetCommitMode offsetCommitMode,
MetricGroup kafkaMetricGroup,
boolean useMetrics)
Creates the fetcher that connect to the Kafka brokers, pulls data, deserialized the
data, and emits it into the data streams.
|
void |
FlinkKafkaConsumerBase.run(SourceFunction.SourceContext<T> sourceContext) |
Constructor and Description |
---|
Kafka010Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KeyedDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Kafka09Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
String taskNameWithSubtasks,
KeyedDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long pollTimeout,
MetricGroup subtaskMetricGroup,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Modifier and Type | Field and Description |
---|---|
protected SourceFunction.SourceContext<T> |
AbstractFetcher.sourceContext
The source context to emit records and watermarks to.
|
Constructor and Description |
---|
AbstractFetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> seedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
ProcessingTimeService processingTimeProvider,
long autoWatermarkInterval,
ClassLoader userCodeClassLoader,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Kafka08Fetcher(SourceFunction.SourceContext<T> sourceContext,
Map<KafkaTopicPartition,Long> seedPartitionsWithInitialOffsets,
SerializedValue<AssignerWithPeriodicWatermarks<T>> watermarksPeriodic,
SerializedValue<AssignerWithPunctuatedWatermarks<T>> watermarksPunctuated,
StreamingRuntimeContext runtimeContext,
KeyedDeserializationSchema<T> deserializer,
Properties kafkaProperties,
long autoCommitInterval,
MetricGroup consumerMetricGroup,
boolean useMetrics) |
Modifier and Type | Method and Description |
---|---|
void |
NiFiSource.run(SourceFunction.SourceContext<NiFiDataPacket> ctx) |
Modifier and Type | Method and Description |
---|---|
void |
RMQSource.run(SourceFunction.SourceContext<OUT> ctx) |
Modifier and Type | Method and Description |
---|---|
void |
TwitterSource.run(SourceFunction.SourceContext<String> ctx) |
Modifier and Type | Method and Description |
---|---|
void |
WikipediaEditsSource.run(SourceFunction.SourceContext<WikipediaEditEvent> ctx) |
Modifier and Type | Method and Description |
---|---|
void |
IncrementalLearningSkeleton.FiniteNewDataSource.run(SourceFunction.SourceContext<Integer> ctx) |
void |
IncrementalLearningSkeleton.FiniteTrainingDataSource.run(SourceFunction.SourceContext<Integer> collector) |
Copyright © 2014–2018 The Apache Software Foundation. All rights reserved.