google_api_dataflow v0.8.0 GoogleApi.Dataflow.V1b3.Model.SourceSplitRequest View Source
Represents the operation to split a high-level Source specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used "as is". Otherwise, splitting is applied recursively to each produced DerivedSource. As an optimization, for any Source, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest. This applies both to the initial source being split and to bundles produced from it.
Attributes
- options (SourceSplitOptions): Hints for tuning the splitting process. Defaults to:
null
. - source (Source): Specification of the source to be split. Defaults to:
null
.
Link to this section Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Link to this section Types
t()
View Source
t() :: %GoogleApi.Dataflow.V1b3.Model.SourceSplitRequest{
options: GoogleApi.Dataflow.V1b3.Model.SourceSplitOptions.t(),
source: GoogleApi.Dataflow.V1b3.Model.Source.t()
}
t() :: %GoogleApi.Dataflow.V1b3.Model.SourceSplitRequest{ options: GoogleApi.Dataflow.V1b3.Model.SourceSplitOptions.t(), source: GoogleApi.Dataflow.V1b3.Model.Source.t() }
Link to this section Functions
decode(value, options) View Source
Unwrap a decoded JSON object into its complex fields.