View Source TextGenerationInference.GenerateParameters (text_generation_inference v0.1.1)

Provides struct and type for GenerateParameters

Link to this section Summary

Link to this section Types

@type t() :: %TextGenerationInference.GenerateParameters{
  best_of: integer() | nil,
  details: boolean() | nil,
  do_sample: boolean() | nil,
  max_new_tokens: integer() | nil,
  repetition_penalty: number() | nil,
  return_full_text: boolean() | nil,
  seed: integer() | nil,
  stop: [String.t()] | nil,
  temperature: number() | nil,
  top_k: integer() | nil,
  top_p: number() | nil,
  truncate: integer() | nil,
  typical_p: number() | nil,
  watermark: boolean() | nil
}