View Source TextGenerationInference.GenerateParameters (text_generation_inference v0.1.2)
Provides struct and type for GenerateParameters
Link to this section Summary
Link to this section Types
@type t() :: %TextGenerationInference.GenerateParameters{ best_of: integer() | nil, details: boolean() | nil, do_sample: boolean() | nil, max_new_tokens: integer() | nil, repetition_penalty: number() | nil, return_full_text: boolean() | nil, seed: integer() | nil, stop: [String.t()] | nil, temperature: number() | nil, top_k: integer() | nil, top_p: number() | nil, truncate: integer() | nil, typical_p: number() | nil, watermark: boolean() | nil }