View Source Agens.Serving.Config (agens v0.1.2)

The Config struct represents the configuration for a Serving process.

Fields

  • :name - The name of the Agens.Serving process.
  • :serving - The Nx.Serving struct or GenServer module for the Agens.Serving.
  • :prompts - A map of custom prompt prefixes. If nil, default prompt prefixes will be used instead. Default prompt prefixes can also be overridden by using the prompts options in Agens.Supervisor.

Summary

Types

@type t() :: %Agens.Serving.Config{
  name: atom(),
  prompts: map() | nil,
  serving: Nx.Serving.t() | module()
}