Modifier and Type | Class and Description |
---|---|
class |
ContinuousFileMonitoringFunction<OUT>
This is the single (non-parallel) task which takes a
FileInputFormat and is responsible for
i) monitoring a user-provided path, ii) deciding which files should be further read and processed,
iii) creating the FileInputSplits corresponding to those files, and iv) assigning
them to downstream tasks for further reading and processing. |
class |
MessageAcknowledgingSourceBase<Type,UId>
Abstract base class for data sources that receive elements from a message queue and
acknowledge them back by IDs.
|
class |
MultipleIdsMessageAcknowledgingSourceBase<Type,UId,SessionId>
Abstract base class for data sources that receive elements from a message queue and
acknowledge them back by IDs.
|
Modifier and Type | Class and Description |
---|---|
class |
RMQSource<OUT>
RabbitMQ source (consumer) which reads from a queue and acknowledges messages on checkpoints.
|
Modifier and Type | Class and Description |
---|---|
class |
TwitterSource
Implementation of
SourceFunction specialized to emit tweets from
Twitter. |
Modifier and Type | Class and Description |
---|---|
class |
WikipediaEditsSource |
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.