Modifier and Type | Method and Description |
---|---|
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
byte[] value)
Uploads the data of the given byte array for the given job to the BLOB server and makes it
a permanent BLOB.
|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
byte[] value) |
PermanentBlobKey |
BlobWriter.putPermanent(JobID jobId,
InputStream inputStream)
Uploads the data from the given input stream for the given job to the BLOB server and makes it
a permanent BLOB.
|
PermanentBlobKey |
BlobServer.putPermanent(JobID jobId,
InputStream inputStream) |
PermanentBlobKey |
VoidBlobWriter.putPermanent(JobID jobId,
InputStream inputStream) |
PermanentBlobKey |
BlobClient.uploadFile(JobID jobId,
Path file)
Uploads a single file to the
PermanentBlobService of the given BlobServer . |
Modifier and Type | Method and Description |
---|---|
static <T> Either<SerializedValue<T>,PermanentBlobKey> |
BlobWriter.serializeAndTryOffload(T value,
JobID jobId,
BlobWriter blobWriter)
Serializes the given value and offloads it to the BlobServer if its size exceeds the minimum
offloading size of the BlobServer.
|
static List<PermanentBlobKey> |
BlobClient.uploadFiles(InetSocketAddress serverAddress,
Configuration clientConfig,
JobID jobId,
List<Path> files)
Uploads the JAR files to the
PermanentBlobService of the BlobServer at the
given address with HA as configured. |
Modifier and Type | Method and Description |
---|---|
File |
PermanentBlobService.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
BlobServer.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
File |
PermanentBlobCache.getFile(JobID jobId,
PermanentBlobKey key)
Returns the path to a local copy of the file associated with the provided job ID and blob
key.
|
Modifier and Type | Field and Description |
---|---|
PermanentBlobKey |
TaskDeploymentDescriptor.Offloaded.serializedValueKey
The key of the offloaded value BLOB.
|
Constructor and Description |
---|
Offloaded(PermanentBlobKey serializedValueKey) |
Modifier and Type | Method and Description |
---|---|
void |
BlobLibraryCacheManager.registerJob(JobID id,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.registerJob(JobID id,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job with its required jar files and classpaths.
|
void |
BlobLibraryCacheManager.registerTask(JobID jobId,
ExecutionAttemptID task,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths) |
void |
LibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Registers a job task execution with its required jar files and classpaths.
|
Modifier and Type | Method and Description |
---|---|
Either<SerializedValue<JobInformation>,PermanentBlobKey> |
ExecutionGraph.getJobInformationOrBlobKey() |
Collection<PermanentBlobKey> |
JobInformation.getRequiredJarFileBlobKeys() |
Collection<PermanentBlobKey> |
ExecutionGraph.getRequiredJarFiles()
Returns a list of BLOB keys referring to the JAR files required to run this job.
|
Either<SerializedValue<TaskInformation>,PermanentBlobKey> |
ExecutionJobVertex.getTaskInformationOrBlobKey() |
Constructor and Description |
---|
JobInformation(JobID jobId,
String jobName,
SerializedValue<ExecutionConfig> serializedExecutionConfig,
Configuration jobConfiguration,
Collection<PermanentBlobKey> requiredJarFileBlobKeys,
Collection<URL> requiredClasspathURLs) |
Modifier and Type | Method and Description |
---|---|
List<PermanentBlobKey> |
JobGraph.getUserJarBlobKeys()
Returns a set of BLOB keys referring to the JAR files required to run this job.
|
Modifier and Type | Method and Description |
---|---|
void |
JobGraph.addUserJarBlobKey(PermanentBlobKey key)
Adds the BLOB referenced by the key to the JobGraph's dependencies.
|
void |
JobGraph.setUserArtifactBlobKey(String entryName,
PermanentBlobKey blobKey) |
Modifier and Type | Method and Description |
---|---|
Collection<PermanentBlobKey> |
ClassloadingProps.getRequiredJarFiles() |
Constructor and Description |
---|
ClassloadingProps(int blobManagerPort,
Collection<PermanentBlobKey> requiredJarFiles,
Collection<URL> requiredClasspaths)
Constructor of ClassloadingProps.
|
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.