GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation (google_api_ai_platform v0.27.0)
View SourceDraft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.
Attributes
-
draftModel
(type:String.t
, default:nil
) - Required. The resource name of the draft model.
Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Types
@type t() :: %GoogleApi.AIPlatform.V1.Model.GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation{ draftModel: String.t() | nil }