google_api_dataproc v0.25.0 API Reference

Modules

API calls for all endpoints tagged Projects.

Handle Tesla connections for GoogleApi.Dataproc.V1.

Specifies the type and number of accelerator cards attached to the instances of an instance. See GPUs on Compute Engine.

Autoscaling Policy config associated with the cluster.

Describes an autoscaling policy for Dataproc cluster autoscaler.

Basic autoscaling configurations for YARN.

Associates members with a role.

Describes the identifying information, config, and status of a cluster of Compute Engine instances.

Contains cluster daemon metrics, such as HDFS and YARN stats.Beta Feature: This report is available for testing purposes only. It may be changed before final release.

The cluster operation triggered by a workflow.

Metadata describing the operation.

A selector that chooses target cluster for jobs based on metadata.

The status of a cluster and its instances.

A request to collect cluster diagnostic information.

The location of diagnostic output.

Specifies the config of disk options for a group of VM instances.

A generic empty message that you can re-use to avoid defining duplicated empty messages in your APIs. A typical example is to use it as the request or the response type of an API method. For instance: service Foo { rpc Bar(google.protobuf.Empty) returns (google.protobuf.Empty); } The JSON representation for Empty is empty JSON object {}.

Encryption settings for the cluster.

Represents an expression text. Example: title: "User account presence" description: "Determines whether the request has a user account" expression: "size(request.user) > 0"

Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.

Request message for GetIamPolicy method.

Encapsulates settings provided to GetIamPolicy.

A Cloud Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN.

Configuration for the size bounds of an instance group, including its proportional size to other groups.

Optional. The config settings for Compute Engine resources in an instance group, such as a master or worker group.

A request to instantiate a workflow template.

A Cloud Dataproc job resource.

Cloud Dataproc job config.

Encapsulates the full scoping used to reference a job.

Cloud Dataproc job status.

Specifies Kerberos related configuration.

Specifies the cluster auto-delete schedule configuration.

A response to a request to list autoscaling policies in a project.

The list of all clusters in a project.

A list of jobs in a project.

The response message for Operations.ListOperations.

A response to a request to list workflow templates in a project.

The runtime logging config of the job.

Cluster that is managed by the workflow.

Specifies the resources used to actively manage an instance group.

Specifies an executable to run on a fully configured node and a timeout period for executable completion.

This resource represents a long-running operation that is the result of a network API call.

A job executed by the workflow.

Configuration for parameter validation.

A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

An Identity and Access Management (IAM) policy, which specifies access controls for Google Cloud resources.A Policy is a collection of bindings. A binding binds one or more members to a single role. Members can be user accounts, service accounts, Google groups, and domains (such as G Suite). A role is a named list of permissions; each role can be an IAM predefined role or a user-created custom role.Optionally, a binding can specify a condition, which is a logical expression that allows access to a resource only if the expression evaluates to true. A condition can add constraints based on attributes of the request, the resource, or both.JSON example: { "bindings": [

A Cloud Dataproc job for running Apache PySpark (https://spark.apache.org/docs/0.9.0/python-programming-guide.html) applications on YARN.

A list of queries to run on a cluster.

Validation based on regular expressions.

Reservation Affinity for consuming Zonal reservation.

Security related configuration, including Kerberos.

Request message for SetIamPolicy method.

Specifies the selection and config of software inside the cluster.

A Cloud Dataproc job for running Apache Spark (http://spark.apache.org/) applications on YARN.

A Cloud Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN.

A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

The Status type defines a logical error model that is suitable for different programming environments, including REST APIs and RPC APIs. It is used by gRPC (https://github.com/grpc). Each Status message contains three pieces of data: error code, error message, and error details.You can find out more about this error model and how to work with it in the API Design Guide (https://cloud.google.com/apis/design/errors).

A configurable parameter that replaces one or more fields in the template. Parameterizable fields: - Labels - File uris - Job properties - Job arguments - Script variables - Main class (in HadoopJob and SparkJob) - Zone (in ClusterSelector)

Request message for TestIamPermissions method.

Response message for TestIamPermissions method.

Validation based on a list of allowed values.

A Cloud Dataproc workflow template resource.

A Cloud Dataproc workflow template resource.

Specifies workflow execution target.Either managed_cluster or cluster_selector is required.

A YARN application created by a job. Application information is a subset of org.apache.hadoop.yarn.proto.YarnProtos.ApplicationReportProto.Beta Feature: This report is available for testing purposes only. It may be changed before final release.