View Source TextGenerationInference.BestOfSequence (text_generation_inference v0.1.0)

Provides struct and type for BestOfSequence

Link to this section Summary

Link to this section Types

@type t() :: %TextGenerationInference.BestOfSequence{
  finish_reason: String.t(),
  generated_text: String.t(),
  generated_tokens: integer(),
  prefill: [TextGenerationInference.PrefillToken.t()],
  seed: integer() | nil,
  tokens: [TextGenerationInference.Token.t()]
}