Mimir.Placement (Mimir v0.4.0)

Copy Markdown View Source

The flat chosen-model placement from a route response: which lane, model, and runtime the workload was placed on. Wire vocabulary — distinct from Mimir.Oracle.Decision, the rich server-side decision.

Summary

Types

t()

Types

t()

@type t() :: %Mimir.Placement{
  lane: String.t() | nil,
  model: String.t(),
  runtime: String.t() | nil
}