Modifier and Type | Method and Description |
---|---|
BlobKey |
BlobClient.put(byte[] value)
Uploads the data of the given byte array to the BLOB server in a content-addressable manner.
|
BlobKey |
BlobClient.put(byte[] value,
int offset,
int len)
Uploads data from the given byte array to the BLOB server in a content-addressable manner.
|
BlobKey |
BlobClient.put(InputStream inputStream)
Uploads the data from the given input stream to the BLOB server in a content-addressable manner.
|
Modifier and Type | Method and Description |
---|---|
int |
BlobKey.compareTo(BlobKey o) |
void |
BlobService.delete(BlobKey key)
This method deletes the file associated with the provided blob key.
|
void |
BlobServer.delete(BlobKey key)
This method deletes the file associated to the blob key if it exists in the local storage
of the blob server.
|
void |
BlobClient.delete(BlobKey key)
Deletes the BLOB identified by the given BLOB key from the BLOB server.
|
void |
BlobCache.delete(BlobKey key)
Deletes the file associated with the given key from the BLOB cache.
|
InputStream |
BlobClient.get(BlobKey blobKey)
Downloads the BLOB identified by the given BLOB key from the BLOB server.
|
URL |
BlobService.getURL(BlobKey key)
This method returns the URL of the file associated with the provided blob key.
|
URL |
BlobServer.getURL(BlobKey requiredBlob)
Method which retrieves the URL of a file associated with a blob key.
|
URL |
BlobCache.getURL(BlobKey requiredBlob)
Returns the URL for the BLOB with the given key.
|
Modifier and Type | Method and Description |
---|---|
List<BlobKey> |
TaskDeploymentDescriptor.getRequiredJarFiles() |
Constructor and Description |
---|
TaskDeploymentDescriptor(JobID jobID,
JobVertexID vertexID,
ExecutionAttemptID executionId,
String taskName,
int indexInSubtaskGroup,
int numberOfSubtasks,
int attemptNumber,
Configuration jobConfiguration,
Configuration taskConfiguration,
String invokableClassName,
List<ResultPartitionDeploymentDescriptor> producedPartitions,
List<InputGateDeploymentDescriptor> inputGates,
List<BlobKey> requiredJarFiles,
List<URL> requiredClasspaths,
int targetSlotNumber) |
TaskDeploymentDescriptor(JobID jobID,
JobVertexID vertexID,
ExecutionAttemptID executionId,
String taskName,
int indexInSubtaskGroup,
int numberOfSubtasks,
int attemptNumber,
Configuration jobConfiguration,
Configuration taskConfiguration,
String invokableClassName,
List<ResultPartitionDeploymentDescriptor> producedPartitions,
List<InputGateDeploymentDescriptor> inputGates,
List<BlobKey> requiredJarFiles,
List<URL> requiredClasspaths,
int targetSlotNumber,
SerializedValue<StateHandle<?>> operatorState,
long recoveryTimestamp)
Constructs a task deployment descriptor.
|
Modifier and Type | Method and Description |
---|---|
File |
LibraryCacheManager.getFile(BlobKey blobKey)
Returns a file handle to the file identified by the blob key.
|
File |
FallbackLibraryCacheManager.getFile(BlobKey blobKey) |
File |
BlobLibraryCacheManager.getFile(BlobKey blobKey) |
Modifier and Type | Method and Description |
---|---|
void |
LibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job with its required jar files and classpaths.
|
void |
FallbackLibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
BlobLibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job task execution with its required jar files and classpaths.
|
void |
FallbackLibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
BlobLibraryCacheManager.registerTask(JobID jobId,
ExecutionAttemptID task,
Collection<BlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
Modifier and Type | Method and Description |
---|---|
List<BlobKey> |
ExecutionGraph.getRequiredJarFiles()
Returns a list of BLOB keys referring to the JAR files required to run this job
|
Constructor and Description |
---|
ExecutionGraph(scala.concurrent.ExecutionContext executionContext,
JobID jobId,
String jobName,
Configuration jobConfig,
scala.concurrent.duration.FiniteDuration timeout,
RestartStrategy restartStrategy,
List<BlobKey> requiredJarFiles,
List<URL> requiredClasspaths,
ClassLoader userClassLoader) |
Modifier and Type | Method and Description |
---|---|
List<BlobKey> |
JobGraph.getUserJarBlobKeys()
Returns a set of BLOB keys referring to the JAR files required to run this job.
|
Modifier and Type | Method and Description |
---|---|
void |
JobGraph.addBlob(BlobKey key)
Adds the BLOB referenced by the key to the JobGraph's dependencies.
|
Copyright © 2014–2017 The Apache Software Foundation. All rights reserved.