LLMProxy.Providers.Execution (llm_proxy v0.1.0)

Copy Markdown View Source

Executes provider attempts with timeout, retry, fallback, telemetry, and circuit-breaker handling.

On retryable errors (5xx, timeout, connection errors), tries fallback providers configured via config :llm_proxy, :fallbacks. Rate-limited (429) tokens are marked and the next token/provider is tried.

Summary

Functions

call(provider, body, user_id, model)
call_attempts(attempts, body, user_id)
call_native_attempts(attempts, request, user_id, api_name)
stream(provider, body, user_id, model)
stream_attempts(attempts, body, user_id)
stream_native_attempts(attempts, request, user_id, api_name)

Functions

call(provider, body, user_id, model)

call_attempts(attempts, body, user_id)

call_native_attempts(attempts, request, user_id, api_name)

stream(provider, body, user_id, model)

stream_attempts(attempts, body, user_id)

stream_native_attempts(attempts, request, user_id, api_name)