LLMProxy.Providers.Execution (llm_proxy v0.2.0)

Executes bounded provider attempts with replay-safe fallback, telemetry, timeouts, and circuit-breaker handling.

Proven pre-dispatch failures and refusals can use the next route. Timeouts and server errors require the explicit uncertain-replay compatibility policy.

Summary

Functions

call(provider, body, user_id, model)

call_attempts(attempts, body, user_id)

call_native_attempts(attempts, request, user_id, api_name)

stream(provider, body, user_id, model)

stream_attempts(attempts, body, user_id)

stream_native_attempts(attempts, request, user_id, api_name)

Functions

call(provider, body, user_id, model)

call_attempts(attempts, body, user_id)

call_native_attempts(attempts, request, user_id, api_name)

stream(provider, body, user_id, model)

stream_attempts(attempts, body, user_id)

stream_native_attempts(attempts, request, user_id, api_name)