llm_proxy
v0.1.0
Search documentation of llm_proxy
Default
Default
In-browser search
Settings
LLMProxy.
Providers.
OpenAICompatible
(llm_proxy v0.1.0)
Copy Markdown
View Source
Shared HTTP client implementation for upstream providers with OpenAI-compatible chat endpoints.
Summary
Functions
call(provider_name, body, user_id, opts)
extract_usage(response)
stream(provider_name, body, user_id, opts)
Functions
call(provider_name, body, user_id, opts)
extract_usage(response)
stream(provider_name, body, user_id, opts)