google_api_dataflow v0.20.0 GoogleApi.Dataflow.V1b3.Model.WorkItemServiceState View Source

The Dataflow service's idea of the current state of a WorkItem being processed by a worker.

Attributes

  • harnessData (type: map(), default: nil) - Other data returned by the service, specific to the particular worker harness.
  • hotKeyDetection (type: GoogleApi.Dataflow.V1b3.Model.HotKeyDetection.t, default: nil) - A hot key is a symptom of poor data distribution in which there are enough elements mapped to a single key to impact pipeline performance. When present, this field includes metadata associated with any hot key.
  • leaseExpireTime (type: DateTime.t, default: nil) - Time at which the current lease will expire.
  • metricShortId (type: list(GoogleApi.Dataflow.V1b3.Model.MetricShortId.t), default: nil) - The short ids that workers should use in subsequent metric updates. Workers should strive to use short ids whenever possible, but it is ok to request the short_id again if a worker lost track of it (e.g. if the worker is recovering from a crash). NOTE: it is possible that the response may have short ids for a subset of the metrics.
  • nextReportIndex (type: String.t, default: nil) - The index value to use for the next report sent by the worker. Note: If the report call fails for whatever reason, the worker should reuse this index for subsequent report attempts.
  • reportStatusInterval (type: String.t, default: nil) - New recommended reporting interval.
  • splitRequest (type: GoogleApi.Dataflow.V1b3.Model.ApproximateSplitRequest.t, default: nil) - The progress point in the WorkItem where the Dataflow service suggests that the worker truncate the task.
  • suggestedStopPoint (type: GoogleApi.Dataflow.V1b3.Model.ApproximateProgress.t, default: nil) - DEPRECATED in favor of split_request.
  • suggestedStopPosition (type: GoogleApi.Dataflow.V1b3.Model.Position.t, default: nil) - Obsolete, always empty.

Link to this section Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Link to this section Types

Link to this type

t()

View Source
t() :: %GoogleApi.Dataflow.V1b3.Model.WorkItemServiceState{
  harnessData: map(),
  hotKeyDetection: GoogleApi.Dataflow.V1b3.Model.HotKeyDetection.t(),
  leaseExpireTime: DateTime.t(),
  metricShortId: [GoogleApi.Dataflow.V1b3.Model.MetricShortId.t()],
  nextReportIndex: String.t(),
  reportStatusInterval: String.t(),
  splitRequest: GoogleApi.Dataflow.V1b3.Model.ApproximateSplitRequest.t(),
  suggestedStopPoint: GoogleApi.Dataflow.V1b3.Model.ApproximateProgress.t(),
  suggestedStopPosition: GoogleApi.Dataflow.V1b3.Model.Position.t()
}

Link to this section Functions

Link to this function

decode(value, options)

View Source
decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.