Nous.ModelDispatcher (nous v0.17.0)
View SourceDispatches model requests to the appropriate provider implementation.
Routes requests to providers based on the model's provider field:
:anthropic→Nous.Providers.Anthropic:gemini→Nous.Providers.Gemini:vertex_ai→Nous.Providers.VertexAI:mistral→Nous.Providers.Mistral:lmstudio→Nous.Providers.LMStudio:llamacpp→Nous.Providers.LlamaCpp:vllm→Nous.Providers.VLLM:sglang→Nous.Providers.SGLang:openai→Nous.Providers.OpenAI:custom→Nous.Providers.Custom- Others →
Nous.Providers.OpenAICompatible
Summary
Functions
Count tokens (uses appropriate provider implementation).
Resolve the provider module for a provider atom.
Dispatch request to the appropriate provider implementation.
Dispatch streaming request to the appropriate provider implementation.
Functions
@spec count_tokens(Nous.Model.t(), list()) :: integer()
Count tokens (uses appropriate provider implementation).
Resolve the provider module for a provider atom.
Unknown providers fall back to Nous.Providers.OpenAICompatible.
@spec request(Nous.Model.t(), list(), map()) :: {:ok, map()} | {:error, term()}
Dispatch request to the appropriate provider implementation.
@spec request_stream(Nous.Model.t(), list(), map()) :: {:ok, Enumerable.t()} | {:error, term()}
Dispatch streaming request to the appropriate provider implementation.