org.apache.flink.streaming.connectors.cassandra

Class CassandraCommitter

java.lang.Object

org.apache.flink.streaming.runtime.operators.CheckpointCommitter

org.apache.flink.streaming.connectors.cassandra.CassandraCommitter

All Implemented Interfaces:

Serializable

public class CassandraCommitter
extends CheckpointCommitter

CheckpointCommitter that saves information about completed checkpoints within a separate table in a cassandra database.

Entries are in the form |operator_id | subtask_id | last_completed_checkpoint|

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.runtime.operators.CheckpointCommitter

jobId, LOG, operatorId

Constructor Summary

Constructors

Constructor and Description
CassandraCommitter(ClusterBuilder builder)
CassandraCommitter(ClusterBuilder builder, String keySpace)

Method Summary

Modifier and Type	Method and Description
void	close() Closes the resource/connection to it.
void	commitCheckpoint(int subtaskIdx, long checkpointId) Mark the given checkpoint as completed in the resource.
void	createResource() Generates the necessary tables to store information.
boolean	isCheckpointCommitted(int subtaskIdx, long checkpointId) Checked the resource whether the given checkpoint was committed completely.
void	open() Opens/connects to the resource, and possibly creates it beforehand.
void	setJobId(String id) Internally used to set the job ID after instantiation.

Methods inherited from class org.apache.flink.streaming.runtime.operators.CheckpointCommitter

setOperatorId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CassandraCommitter

public CassandraCommitter(ClusterBuilder builder)

CassandraCommitter

public CassandraCommitter(ClusterBuilder builder,
                          String keySpace)

Method Detail

setJobId

public void setJobId(String id)
              throws Exception

Internally used to set the job ID after instantiation.

Overrides:

setJobId in class CheckpointCommitter

Throws:

Exception

createResource

public void createResource()
                    throws Exception

Generates the necessary tables to store information.

Specified by:

createResource in class CheckpointCommitter

Throws:

Exception

open

public void open()
          throws Exception

Description copied from class: CheckpointCommitter

Opens/connects to the resource, and possibly creates it beforehand.

Specified by:

open in class CheckpointCommitter

Throws:

Exception

close

public void close()
           throws Exception

Description copied from class: CheckpointCommitter

Closes the resource/connection to it. The resource should generally still exist after this call.

Specified by:

close in class CheckpointCommitter

Throws:

Exception

commitCheckpoint

public void commitCheckpoint(int subtaskIdx,
                             long checkpointId)

Description copied from class: CheckpointCommitter

Mark the given checkpoint as completed in the resource.

Specified by:

commitCheckpoint in class CheckpointCommitter

Parameters:

subtaskIdx - the index of the subtask responsible for committing the checkpoint.

checkpointId - the id of the checkpoint to be committed.

isCheckpointCommitted

public boolean isCheckpointCommitted(int subtaskIdx,
                                     long checkpointId)

Description copied from class: CheckpointCommitter

Checked the resource whether the given checkpoint was committed completely.

Specified by:

isCheckpointCommitted in class CheckpointCommitter

Parameters:

subtaskIdx - the index of the subtask responsible for committing the checkpoint.

checkpointId - the id of the checkpoint we are interested in.

Returns:

true if the checkpoint was committed completely, false otherwise