Candil.Backend.LlamaCpp (Candil v3.0.0)

Copy Markdown View Source

Candil.Backend implementation for local llama.cpp / llama-server.

Wraps Candil.Llm.chat/3, Candil.Llm.stream/4, and Candil.Embeddings.embed/3. This backend is the default for provider: :local and is auto-registered on first call.