google_api_dataflow v0.8.0 GoogleApi.Dataflow.V1b3.Model.Environment View Source
Describes the environment in which a Dataflow Job runs.
Attributes
- clusterManagerApiService (String.t): The type of cluster manager API to use. If unknown or unspecified, the service will attempt to choose a reasonable default. This should be in the form of the API service name, e.g. "compute.googleapis.com". Defaults to:
null
. - dataset (String.t): The dataset for the current project where various workflow related tables are stored. The supported resource type is: Google BigQuery: bigquery.googleapis.com/{dataset} Defaults to:
null
. - experiments ([String.t]): The list of experiments to enable. Defaults to:
null
. flexResourceSchedulingGoal (String.t): Which Flexible Resource Scheduling mode to run in. Defaults to:
null
.- Enum - one of [FLEXRS_UNSPECIFIED, FLEXRS_SPEED_OPTIMIZED, FLEXRS_COST_OPTIMIZED]
- internalExperiments (%{optional(String.t) => String.t}): Experimental settings. Defaults to:
null
. - sdkPipelineOptions (%{optional(String.t) => String.t}): The Cloud Dataflow SDK pipeline options specified by the user. These options are passed through the service and are used to recreate the SDK pipeline options on the worker in a language agnostic and platform independent way. Defaults to:
null
. - serviceAccountEmail (String.t): Identity to run virtual machines as. Defaults to the default account. Defaults to:
null
. - serviceKmsKeyName (String.t): If set, contains the Cloud KMS key identifier used to encrypt data at rest, AKA a Customer Managed Encryption Key (CMEK). Format: projects/PROJECT_ID/locations/LOCATION/keyRings/KEY_RING/cryptoKeys/KEY Defaults to:
null
. - tempStoragePrefix (String.t): The prefix of the resources the system should use for temporary storage. The system will append the suffix "/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object} Defaults to:
null
. - userAgent (%{optional(String.t) => String.t}): A description of the process that generated the request. Defaults to:
null
. - version (%{optional(String.t) => String.t}): A structure describing which components and their versions of the service are required in order to run the job. Defaults to:
null
. - workerPools ([WorkerPool]): The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers. Defaults to:
null
.
Link to this section Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Link to this section Types
Link to this type
t()
View Source
t()
View Source
t() :: %GoogleApi.Dataflow.V1b3.Model.Environment{
clusterManagerApiService: any(),
dataset: any(),
experiments: [any()],
flexResourceSchedulingGoal: any(),
internalExperiments: map(),
sdkPipelineOptions: map(),
serviceAccountEmail: any(),
serviceKmsKeyName: any(),
tempStoragePrefix: any(),
userAgent: map(),
version: map(),
workerPools: [GoogleApi.Dataflow.V1b3.Model.WorkerPool.t()]
}
t() :: %GoogleApi.Dataflow.V1b3.Model.Environment{ clusterManagerApiService: any(), dataset: any(), experiments: [any()], flexResourceSchedulingGoal: any(), internalExperiments: map(), sdkPipelineOptions: map(), serviceAccountEmail: any(), serviceKmsKeyName: any(), tempStoragePrefix: any(), userAgent: map(), version: map(), workerPools: [GoogleApi.Dataflow.V1b3.Model.WorkerPool.t()] }
Link to this section Functions
Link to this function
decode(value, options) View Source
Unwrap a decoded JSON object into its complex fields.