LLMProxy.Providers.Routing.RoundRobin (llm_proxy v0.1.0)

Copy Markdown View Source

GenServer-backed routing strategy that rotates deployments within each order group by model name.

Summary

Functions

child_spec(init_arg)

Returns a specification to start this module under a supervisor.

order(name, deployments)
reset()
start_link(opts)

Functions

child_spec(init_arg)

Returns a specification to start this module under a supervisor.

See Supervisor.

order(name, deployments)

@spec order(String.t(), [term()]) :: [term()]

reset()

@spec reset() :: :ok

start_link(opts)

@spec start_link(keyword()) :: GenServer.on_start()