Modules
Candil — LLM inference and model management for Elixir.
OTP application for Candil.
Engine and model registry for Candil.Llm.
Reads, validates, and normalizes LLM/embedding provider configuration.
Conversation history management for Candil.Llm.
Cost estimation for LLM API usage.
System capability detection for llama.cpp precompiled binary selection.
Embedding generation abstraction over multiple providers.
Local llama.cpp engine definition and lifecycle management.
GenServer that manages a single llama-server OS process.
Unified error types for Candil.
Shared HTTP client with circuit breaker, retry, and rate limiting for Candil.
Health checks for LLM/embedding providers.
Inference execution for Candil.
Download and installation utilities for llama.cpp binaries and GGUF models.
LLM model definition for Candil.
Remote LLM provider definition for Candil.
Shared request body builders for LLM providers.
Server-Sent Events (SSE) streaming for LLM inference.