GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation (google_api_ai_platform v0.27.0)

View Source

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Attributes

  • draftModel (type: String.t, default: nil) - Required. The resource name of the draft model.

Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Types

t()

@type t() ::
  %GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation{
    draftModel: String.t() | nil
  }

Functions

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.