View Source TextGenerationInference.CompatGenerateOptions (text_generation_inference v0.1.1)

Provides struct and type for CompatGenerateOptions

Link to this section Summary

Link to this section Types

@type t() :: %TextGenerationInference.CompatGenerateOptions{
  use_cache: boolean() | nil,
  wait_for_model: boolean() | nil
}