LLMProxy.HTTP.Routes.Passthrough (llm_proxy v0.1.0)

Copy Markdown View Source

Shared provider-passthrough route flow.

Passthrough routes keep the upstream provider API shape at the HTTP boundary while sharing common result dispatch and provider-error dispatch here.

Summary

Functions

error_handler(send_error, provider_error_type, on_provider_error \\ fn _result -> :ok end)
result_handler(non_stream, stream)
send_error(conn, reason, handler)
send_result(conn, result, api_key, trace_id, handler)

Functions

error_handler(send_error, provider_error_type, on_provider_error \\ fn _result -> :ok end)

@spec error_handler(
  LLMProxy.HTTP.Routes.Passthrough.ErrorHandler.send_error(),
  LLMProxy.HTTP.Routes.Passthrough.ErrorHandler.provider_error_type(),
  LLMProxy.HTTP.Routes.Passthrough.ErrorHandler.on_provider_error()
) :: LLMProxy.HTTP.Routes.Passthrough.ErrorHandler.t()

result_handler(non_stream, stream)

@spec result_handler(
  LLMProxy.HTTP.Routes.Passthrough.ResultHandler.non_stream(),
  LLMProxy.HTTP.Routes.Passthrough.ResultHandler.stream()
) :: LLMProxy.HTTP.Routes.Passthrough.ResultHandler.t()

send_error(conn, reason, handler)

@spec send_error(
  Plug.Conn.t(),
  term(),
  LLMProxy.HTTP.Routes.Passthrough.ErrorHandler.t()
) ::
  Plug.Conn.t()

send_result(conn, result, api_key, trace_id, handler)

@spec send_result(
  Plug.Conn.t(),
  LLMProxy.Providers.Result.t(),
  map(),
  String.t(),
  LLMProxy.HTTP.Routes.Passthrough.ResultHandler.t()
) :: Plug.Conn.t()