Mimir is an embeddable routing oracle, pricing source, and decision vocabulary for LLM workloads. Consult it in-process: hand it a workload descriptor and an operational snapshot, and it hands back a placement (or a reasoned no-candidate answer) plus an auditable decision record. A gateway service built on top of Mimir is one possible embedder — not a requirement.
Module inventory
| Module | What it does |
|---|---|
Mimir.Descriptor | Validated workload descriptor — the contract a workflow step presents to the oracle. |
Mimir.Oracle | Pure filter-then-rank placement decision over catalog entries. |
Mimir.Catalog | Config-sourced routable entries, with an injectable model resolver seam. |
Mimir.Snapshot | Explicit-inputs operational snapshot the oracle ranks against (pricing, health, budget). |
Mimir.Health | Failure-streak table for router lanes, driven by telemetry. |
Mimir.DecisionRecord | Typed routing-decision record; to_event/1 renders the binary-keyed audit map. |
Mimir.RouteLog | Typed route outcome plus a request-log meta builder. |
Mimir.Pricing | Token usage to integer microdollar cost, config-first over a vendored LiteLLM pricing DB. |
Mimir.Event | Domain-typed event vocabulary (llm.* / agent.* / workflow.*) — the vocabulary root Mimir.TurnEvents buffers and Mimir.Ingest promotes raw events onto. |
Mimir.Event.OTel | Canonical OTel GenAI semantic-convention rendering for Mimir.Event at the export edge — the one place that vocabulary still lives, on purpose. |
Mimir.TurnEvents | Per-request ordered Mimir.Event buffer; the buffer, not the caller, owns seq/ts. |
Mimir.RouterClient | Behaviour for routing clients, with an HTTP (Req-based) implementation. Returns a parsed %Mimir.RouteResponse{}. |
Mimir.RouteResponse | Parsed routing-call result; new/1 is the single boundary from wire map to struct. |
Mimir.Grant | Minted routing grant: key, budget, expiry. |
Mimir.Placement | Flat chosen-model placement: lane, model, runtime. |
Mimir.Candidate | One catalog entry's routing verdict: chosen, ranked, or excluded. |
Mimir.Redact | Secret masking and payload-capture gating helpers. |
Mimir.Guard | Turn-guard builders for a session's between-turn hook — grant-budget halts and mimir-less caps. |
Mimir.Ingest | Decision-correlated ingestion of raw session events, promoted to Mimir.Event and appended to Mimir.TurnEvents. |
Mimir.Sessions | Canonical recipe: route response to session options (model_config, turn_guard, telemetry_metadata). |
See the README for design rules, supervision, configuration, and a gateway-less worked example.