Nous.StreamNormalizer.LlamaCpp (nous v0.17.0)

View Source

Stream normalizer for LlamaCppEx %ChatCompletionChunk{} structs.

Converts NIF-produced chunk structs into normalized Nous stream events. llama.cpp speaks OpenAI's chat.completion wire shape, so complete (non-delta) responses delegate to Nous.StreamNormalizer.OpenAI — this also keeps content and tool calls when a stream degenerates into a single complete response object.

Requires optional dep: {:llama_cpp_ex, "~> 0.6.5"}