google_api_dataproc v0.15.0 GoogleApi.Dataproc.V1.Model.ClusterConfig View Source
The cluster config.
Attributes
configBucket
(type:String.t
, default:nil
) - Optional. A Google Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Cloud Dataproc staging bucket).encryptionConfig
(type:GoogleApi.Dataproc.V1.Model.EncryptionConfig.t
, default:nil
) - Optional. Encryption settings for the cluster.gceClusterConfig
(type:GoogleApi.Dataproc.V1.Model.GceClusterConfig.t
, default:nil
) - Optional. The shared Compute Engine config settings for all instances in a cluster.initializationActions
(type:list(GoogleApi.Dataproc.V1.Model.NodeInitializationAction.t)
, default:nil
) - Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget): ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1/instance/attributes/dataproc-role) if [[ "${ROLE}" == 'Master' ]]; then ... master specific actions ... else ... worker specific actions ... filifecycleConfig
(type:GoogleApi.Dataproc.V1.Model.LifecycleConfig.t
, default:nil
) - Optional. Lifecycle setting for the cluster.masterConfig
(type:GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t
, default:nil
) - Optional. The Compute Engine config settings for the master instance in a cluster.secondaryWorkerConfig
(type:GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t
, default:nil
) - Optional. The Compute Engine config settings for additional worker instances in a cluster.securityConfig
(type:GoogleApi.Dataproc.V1.Model.SecurityConfig.t
, default:nil
) - Optional. Security settings for the cluster.softwareConfig
(type:GoogleApi.Dataproc.V1.Model.SoftwareConfig.t
, default:nil
) - Optional. The config settings for software inside the cluster.workerConfig
(type:GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t
, default:nil
) - Optional. The Compute Engine config settings for worker instances in a cluster.
Link to this section Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Link to this section Types
t()
View Sourcet() :: %GoogleApi.Dataproc.V1.Model.ClusterConfig{ configBucket: String.t(), encryptionConfig: GoogleApi.Dataproc.V1.Model.EncryptionConfig.t(), gceClusterConfig: GoogleApi.Dataproc.V1.Model.GceClusterConfig.t(), initializationActions: [ GoogleApi.Dataproc.V1.Model.NodeInitializationAction.t() ], lifecycleConfig: GoogleApi.Dataproc.V1.Model.LifecycleConfig.t(), masterConfig: GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t(), secondaryWorkerConfig: GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t(), securityConfig: GoogleApi.Dataproc.V1.Model.SecurityConfig.t(), softwareConfig: GoogleApi.Dataproc.V1.Model.SoftwareConfig.t(), workerConfig: GoogleApi.Dataproc.V1.Model.InstanceGroupConfig.t() }
Link to this section Functions
Unwrap a decoded JSON object into its complex fields.