View Source TextGenerationInference.Details (text_generation_inference v0.1.0)

Provides struct and type for Details

Link to this section Summary

Link to this section Types

@type t() :: %TextGenerationInference.Details{
  best_of_sequences: [TextGenerationInference.BestOfSequence.t()] | nil,
  finish_reason: String.t(),
  generated_tokens: integer(),
  prefill: [TextGenerationInference.PrefillToken.t()],
  seed: integer() | nil,
  tokens: [TextGenerationInference.Token.t()]
}