Nous.Providers.LlamaCpp (nous v0.16.0)

View Source

LlamaCpp NIF-based provider for local LLM inference.

Not available - add {:llama_cpp_ex, "~> 0.6.5"} to your mix.exs deps.