View Source TextGenerationInference.Details (text_generation_inference v0.1.2)
Provides struct and type for Details
Link to this section Summary
Link to this section Types
@type t() :: %TextGenerationInference.Details{ best_of_sequences: [TextGenerationInference.BestOfSequence.t()] | nil, finish_reason: String.t(), generated_tokens: integer(), prefill: [TextGenerationInference.PrefillToken.t()], seed: integer() | nil, tokens: [TextGenerationInference.Token.t()] }