Update Job

dataproc.update_job
ActionGoogle Cloudconnection required

Calls dataproc v1 PATCH /v1/projects/{projectId}/regions/{region}/jobs/{jobId}.

Updates a job in a project.

Connection

Required
Yes — the node will not save without one
Auth type
OAuth 2.0
Providers
Google Cloud Dataproc
Secret shape
{"client_id", "client_secret", "refresh_token"}
Config it needs
project_id, region
Resolved by
config.connection_id, else node.connection_id

Configuration

4 fields, 2 required. A dotted path is a nested object and name[] an array of objects — the editor renders the same tree.

FieldTypeRequiredDefaultConstraintsExample
region
Region; defaults to the connection's zone minus its suffix.
stringNo———
job
Job name or id.
stringYes———
body
The Job resource, as the API defines it.
objectYes———
update_mask
Specifies the path, relative to Job, of the field to update. Optional.
stringNo———

Output

One shape.

result

Extra keys beyond the ones listed can appear.

FieldTypeExample
done
boolean—
driverControlFilesUri
string—
driverOutputResourceUri
string—
driverSchedulingConfig
object—
flinkJob
object—
hadoopJob
object—
hiveJob
object—
jobUuid
string—
labels
object—
pigJob
object—
placement
object—
prestoJob
object—
pysparkJob
object—
reference
object—
scheduling
object—
sparkJob
object—
sparkRJob
object—
sparkSqlJob
object—
status
object—
statusHistory
array—
trinoJob
object—
yarnApplications
array—
{
  "done": false,
  "driverControlFilesUri": "",
  "driverOutputResourceUri": "",
  "driverSchedulingConfig": {},
  "flinkJob": {},
  "hadoopJob": {},
  "hiveJob": {},
  "jobUuid": "",
  "labels": {},
  "pigJob": {},
  "placement": {},
  "prestoJob": {},
  "pysparkJob": {},
  "reference": {},
  "scheduling": {},
  "sparkJob": {},
  "sparkRJob": {},
  "sparkSqlJob": {},
  "status": {},
  "statusHistory": [],
  "trinoJob": {},
  "yarnApplications": []
}

See Update Job run in a workflow.

In a technical demo we add the Google Cloud Dataproc connection, drop the node on the canvas and let Workflow Health pre-flight it before the first real run.