View Source Agens.Serving.Config (agens v0.1.2)
The Config struct represents the configuration for a Serving process.
Fields
:name
- The name of theAgens.Serving
process.:serving
- TheNx.Serving
struct orGenServer
module for theAgens.Serving
.:prompts
- A map of custom prompt prefixes. Ifnil
, default prompt prefixes will be used instead. Default prompt prefixes can also be overridden by using theprompts
options inAgens.Supervisor
.
Summary
Types
@type t() :: %Agens.Serving.Config{ name: atom(), prompts: map() | nil, serving: Nx.Serving.t() | module() }