Inference.Adapter behaviour (inference v0.1.0)

Behaviour implemented by inference adapter modules.

Summary

provider_kind()

complete(t, t)

provider_kind()

stream(t, t)

provider_kinds()

Returns the closed set of valid provider kinds.

Reports whether a value belongs to the closed provider-kind set.

@type provider_kind() :: :model_endpoint | :local_model_endpoint | :agent_session

@callback complete(Inference.Client.t(), Inference.Request.t()) ::
  {:ok, Inference.Response.t()} | {:error, Inference.Error.t()}

@callback provider_kind() :: provider_kind()

(optional)

@callback stream(Inference.Client.t(), Inference.Request.t()) ::
  {:ok, Enumerable.t()} | {:error, Inference.Error.t()}

@spec provider_kinds() :: [provider_kind()]

Returns the closed set of valid provider kinds.

@spec valid_provider_kind?(term()) :: boolean()

Reports whether a value belongs to the closed provider-kind set.