Constructor and Description |
---|
JobExecutionResult(JobID jobID,
long netRuntime,
Map<String,OptionalFailure<Object>> accumulators)
Creates a new JobExecutionResult.
|
Modifier and Type | Method and Description |
---|---|
static Map<String,OptionalFailure<Object>> |
AccumulatorHelper.deserializeAccumulators(Map<String,SerializedValue<OptionalFailure<Object>>> serializedAccumulators,
ClassLoader loader)
Takes the serialized accumulator results and tries to deserialize them using the provided
class loader.
|
static Map<String,OptionalFailure<Object>> |
AccumulatorHelper.toResultMap(Map<String,Accumulator<?,?>> accumulators)
Transform the Map with accumulators into a Map containing only the
results.
|
Modifier and Type | Method and Description |
---|---|
static Map<String,OptionalFailure<Object>> |
AccumulatorHelper.deserializeAccumulators(Map<String,SerializedValue<OptionalFailure<Object>>> serializedAccumulators,
ClassLoader loader)
Takes the serialized accumulator results and tries to deserialize them using the provided
class loader.
|
static void |
AccumulatorHelper.mergeInto(Map<String,OptionalFailure<Accumulator<?,?>>> target,
Map<String,Accumulator<?,?>> toMerge)
Merge two collections of accumulators.
|
Modifier and Type | Method and Description |
---|---|
Map<String,OptionalFailure<Object>> |
ClusterClient.getAccumulators(JobID jobID)
Requests and returns the accumulators for the given job identifier.
|
Map<String,OptionalFailure<Object>> |
MiniClusterClient.getAccumulators(JobID jobID) |
Map<String,OptionalFailure<Object>> |
ClusterClient.getAccumulators(JobID jobID,
ClassLoader loader)
Requests and returns the accumulators for the given job identifier.
|
Map<String,OptionalFailure<Object>> |
MiniClusterClient.getAccumulators(JobID jobID,
ClassLoader loader) |
Modifier and Type | Method and Description |
---|---|
Map<String,OptionalFailure<Object>> |
RestClusterClient.getAccumulators(JobID jobID,
ClassLoader loader) |
Modifier and Type | Method and Description |
---|---|
static StringifiedAccumulatorResult[] |
StringifiedAccumulatorResult.stringifyAccumulatorResults(Map<String,OptionalFailure<Accumulator<?,?>>> accs)
Flatten a map of accumulator names to Accumulator instances into an array of StringifiedAccumulatorResult values.
|
Modifier and Type | Method and Description |
---|---|
Map<String,SerializedValue<OptionalFailure<Object>>> |
SerializedJobExecutionResult.getSerializedAccumulatorResults() |
Constructor and Description |
---|
SerializedJobExecutionResult(JobID jobID,
long netRuntime,
Map<String,SerializedValue<OptionalFailure<Object>>> accumulators)
Creates a new SerializedJobExecutionResult.
|
Modifier and Type | Method and Description |
---|---|
Map<String,OptionalFailure<Accumulator<?,?>>> |
ExecutionGraph.aggregateUserAccumulators()
Merges all accumulator results from the tasks previously executed in the Executions.
|
Map<String,SerializedValue<OptionalFailure<Object>>> |
AccessExecutionGraph.getAccumulatorsSerialized()
Returns a map containing the serialized values of user-defined accumulators.
|
Map<String,SerializedValue<OptionalFailure<Object>>> |
ExecutionGraph.getAccumulatorsSerialized()
Gets a serialized accumulator map.
|
Map<String,SerializedValue<OptionalFailure<Object>>> |
ArchivedExecutionGraph.getAccumulatorsSerialized() |
Constructor and Description |
---|
ArchivedExecutionGraph(JobID jobID,
String jobName,
Map<JobVertexID,ArchivedExecutionJobVertex> tasks,
List<ArchivedExecutionJobVertex> verticesInCreationOrder,
long[] stateTimestamps,
JobStatus state,
ErrorInfo failureCause,
String jsonPlan,
StringifiedAccumulatorResult[] archivedUserAccumulators,
Map<String,SerializedValue<OptionalFailure<Object>>> serializedUserAccumulators,
ArchivedExecutionConfig executionConfig,
boolean isStoppable,
CheckpointCoordinatorConfiguration jobCheckpointingConfiguration,
CheckpointStatsSnapshot checkpointStatsSnapshot) |
Modifier and Type | Method and Description |
---|---|
Map<String,SerializedValue<OptionalFailure<Object>>> |
JobResult.getAccumulatorResults() |
Modifier and Type | Method and Description |
---|---|
JobResult.Builder |
JobResult.Builder.accumulatorResults(Map<String,SerializedValue<OptionalFailure<Object>>> accumulatorResults) |
Modifier and Type | Method and Description |
---|---|
Map<String,SerializedValue<OptionalFailure<Object>>> |
JobAccumulatorsInfo.getSerializedUserAccumulators() |
Constructor and Description |
---|
JobAccumulatorsInfo(List<JobAccumulatorsInfo.JobAccumulator> jobAccumulators,
List<JobAccumulatorsInfo.UserTaskAccumulator> userAccumulators,
Map<String,SerializedValue<OptionalFailure<Object>>> serializedUserAccumulators) |
Modifier and Type | Method and Description |
---|---|
static <T> OptionalFailure<T> |
OptionalFailure.createFrom(CheckedSupplier<T> valueSupplier) |
static <T> OptionalFailure<T> |
OptionalFailure.of(T value) |
static <T> OptionalFailure<T> |
OptionalFailure.ofFailure(Throwable failureCause) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.