ExLLM.Adapters.OpenAICompatible behaviour (ex_llm v0.5.0)
View SourceBase implementation for OpenAI-compatible API providers.
Many LLM providers follow OpenAI's API format, allowing for shared implementation. This module provides common functionality that can be reused across providers.
Usage
Create a new adapter by using this module:
defmodule ExLLM.Adapters.MyProvider do
use ExLLM.Adapters.OpenAICompatible,
provider: :my_provider,
base_url: "https://api.myprovider.com/v1",
models: ["model-1", "model-2"]
# Override any functions as needed
defp transform_request(request, _options) do
# Custom request transformation
request
end
end
Summary
Callbacks
Defines callbacks for OpenAI-compatible adapters.
Functions
Default model transformer for configuration data.
Formats a model ID into a human-readable name.
Callbacks
Defines callbacks for OpenAI-compatible adapters.
@callback parse_model(model :: map()) :: ExLLM.Types.Model.t()