Spectre.Inference.Prepared (Spectre v0.3.3)

Immutable handoff produced after inference selection.

A prepared inference binds the portable descriptor and frozen selection to the provider options and optional streaming adapter selected for the current process. It can appear in the return value of routing and runner APIs when an Instance owns the remaining lifecycle.

This value is process-local dispatch material, not a durable checkpoint. Spectre.Run.InferenceContinuation stores the portable descriptor and frozen selection needed to reconstruct it during recovery.

Summary

Types

t()

Types

t()

@type t() :: %Spectre.Inference.Prepared{
  descriptor: Spectre.Inference.Descriptor.t(),
  frozen_selection: Spectre.Inference.FrozenSelection.t(),
  provider_opts: keyword(),
  selection: Spectre.Inference.Selection.t(),
  stream_adapter: module() | nil,
  stream_adapter_opts: keyword(),
  stream_capabilities: MapSet.t(atom())
}