ReqLLM.
View Source
Meta Llama native-payload helpers used by Amazon Bedrock.
Bedrock's native Llama endpoint uses a formatted prompt, max_gen_len,
generation, and token-count fields instead of Meta's OpenAI-compatible
Model API envelope.
Summary
Functions
Extracts token usage from a native Llama response.
Formats messages using the Llama 3 prompt token convention.
Formats a ReqLLM context into Meta's native Llama request format.
Parses a native Llama response into a ReqLLM response.
Normalizes Meta's native stop reason.
Functions
Extracts token usage from a native Llama response.
Formats messages using the Llama 3 prompt token convention.
Formats a ReqLLM context into Meta's native Llama request format.
Parses a native Llama response into a ReqLLM response.
Normalizes Meta's native stop reason.