View Source TextGenerationInference.PrefillToken (text_generation_inference v0.1.0)

Provides struct and type for PrefillToken

Link to this section Summary

Link to this section Types

@type t() :: %TextGenerationInference.PrefillToken{
  id: integer(),
  logprob: number() | nil,
  text: String.t()
}