Spectre.Inference.Request (Spectre v0.3.0)

Copy Markdown View Source

One typed, purpose-labelled inference invocation.

Summary

Types

t()

Functions

for_classification(plan, ctx, opts)

Builds a route-classification request around an already composed prompt plan.

for_response(plan, ctx, opts)

Builds the response-generation request used by Spectre.Runner.

new(attrs)

Types

t()

@type t() :: %Spectre.Inference.Request{
  attempt: pos_integer(),
  constraints: Spectre.Inference.Constraints.t(),
  flow: term(),
  id: String.t(),
  metadata: map(),
  modalities: [atom()],
  plan: Spectre.Prompt.Plan.t(),
  previous_errors: [term()],
  purpose: term(),
  route: term()
}

Functions

for_classification(plan, ctx, opts)

@spec for_classification(
  Spectre.Prompt.Plan.t(),
  Spectre.Context.t() | map(),
  keyword()
) :: t()

Builds a route-classification request around an already composed prompt plan.

for_response(plan, ctx, opts)

@spec for_response(Spectre.Prompt.Plan.t(), Spectre.Context.t(), keyword()) :: t()

Builds the response-generation request used by Spectre.Runner.

new(attrs)

@spec new(map() | keyword()) :: t()