Nous.Providers.LlamaCpp (nous v0.15.3)

View Source

LlamaCpp NIF-based provider for local LLM inference.

Not available - add {:llama_cpp_ex, "~> 0.6.5"} to your mix.exs deps.