Cyclium.Synthesizer behaviour (Cyclium v0.1.13)

Copy Markdown View Source

Behaviour for LLM synthesis integration. The consuming app provides the implementation.

Summary

Callbacks

estimate_tokens(prompt_ctx)

@callback estimate_tokens(prompt_ctx :: map()) :: non_neg_integer()

synthesize(prompt_ctx, episode_ctx)

@callback synthesize(prompt_ctx :: map(), episode_ctx :: map()) ::
  {:ok, result :: map()} | {:error, error_class :: atom(), detail :: term()}