LLMProxy.Ops (llm_proxy v0.1.0)

Copy Markdown View Source

Local operational RPC surface for deployment lifecycle control.

This is intentionally separate from the Incant/admin surface. It is intended for local deploy tooling over SafeRPC, not for public HTTP traffic.

Summary

Functions

Wait until active work reaches zero.

Cancel drain mode and accept new work again.

Start draining: reject new work while existing work finishes.

Return current drain status.

Functions

drain_await(payload, meta, state)

@spec drain_await(map(), map(), term()) :: :ok | {:error, :timeout}

Wait until active work reaches zero.

drain_cancel(payload, meta, state)

@spec drain_cancel(map(), map(), term()) :: {:ok, map()}

Cancel drain mode and accept new work again.

drain_start(payload, meta, state)

@spec drain_start(map(), map(), term()) :: {:ok, map()}

Start draining: reject new work while existing work finishes.

drain_status(payload, meta, state)

@spec drain_status(map(), map(), term()) :: {:ok, map()}

Return current drain status.