Modules
Engine and model registry for Candil.Llm.
Conversation history management for Candil.Llm.
System capability detection for llama.cpp precompiled binary selection.
Local llama.cpp engine definition and lifecycle management.
GenServer that manages a single llama-server OS process.
Inference execution for Candil.
Download and installation utilities for llama.cpp binaries and GGUF models.
LLM management for Candil.
LLM model definition for Candil.
Remote LLM provider definition for Candil.
Shared request body builders for LLM providers.
Server-Sent Events (SSE) streaming for LLM inference.