Cyclium.Synthesizer behaviour (Cyclium v0.1.5)

Copy Markdown

Behaviour for LLM synthesis integration. The consuming app provides the implementation.

Summary

Callbacks

estimate_tokens(prompt_ctx)
synthesize(prompt_ctx, episode_ctx)

Callbacks

estimate_tokens(prompt_ctx)

@callback estimate_tokens(prompt_ctx :: map()) :: non_neg_integer()

synthesize(prompt_ctx, episode_ctx)

@callback synthesize(prompt_ctx :: map(), episode_ctx :: map()) ::
  {:ok, result :: map()} | {:error, error_class :: atom(), detail :: term()}