public class CheckpointStatsTracker extends Object
This is tightly integrated with the CheckpointCoordinator
in order to ease the
gathering of fine-grained statistics.
The tracked stats include summary counts, a detailed history of recent and in progress checkpoints as well as summaries about the size, duration and more of recent checkpoints.
Data is gathered via callbacks in the CheckpointCoordinator
and related classes like
PendingCheckpoint
and CompletedCheckpoint
, which receive the raw stats data in
the first place.
The statistics are accessed via createSnapshot()
and exposed via both the web
frontend and the Metric
system.
Constructor and Description |
---|
CheckpointStatsTracker(int numRememberedCheckpoints,
List<ExecutionJobVertex> jobVertices,
CheckpointCoordinatorConfiguration jobCheckpointingConfiguration,
MetricGroup metricGroup)
Creates a new checkpoint stats tracker.
|
Modifier and Type | Method and Description |
---|---|
CheckpointStatsSnapshot |
createSnapshot()
Creates a new snapshot of the available stats.
|
CheckpointCoordinatorConfiguration |
getJobCheckpointingConfiguration()
Returns the job's checkpointing configuration which is derived from the CheckpointConfig.
|
public CheckpointStatsTracker(int numRememberedCheckpoints, List<ExecutionJobVertex> jobVertices, CheckpointCoordinatorConfiguration jobCheckpointingConfiguration, MetricGroup metricGroup)
numRememberedCheckpoints
- Maximum number of checkpoints to remember, including in
progress ones.jobVertices
- Job vertices involved in the checkpoints.jobCheckpointingConfiguration
- Checkpointing configuration.metricGroup
- Metric group for exposed metricspublic CheckpointCoordinatorConfiguration getJobCheckpointingConfiguration()
public CheckpointStatsSnapshot createSnapshot()
Copyright © 2014–2021 The Apache Software Foundation. All rights reserved.