Modules
Entry point for the inference layer.
Inference adapter for the Anthropic Messages API.
Inference adapter for Ollama.
Inference adapter for OpenAI-compatible APIs.
GitHub Copilot OAuth device code authentication.
Ensures a model is loaded with the correct configuration on local providers (LM Studio, Ollama, vLLM) before inference begins.
Single entry point for all inference calls.
Canonical request struct for inference calls.
Canonical request struct for media generation calls (image/video).
Canonical response struct from media generation calls.
Declares model capabilities so adapters serialize correctly on the first attempt.
Fetches and caches model capabilities from models.dev.
Resolves a ModelProfile for a given provider and model.
Probes inference providers to determine availability.
Behaviour for inference provider adapters.
Canonical response struct from inference calls.
Profile-driven post-processing of inference responses.