mix arcana.eval.generate (Arcana v2.0.1)

Copy Markdown View Source

Generates synthetic test cases from existing chunks.

Usage

mix arcana.eval.generate --sample-size 50
mix arcana.eval.generate --source-id my-docs --sample-size 100
mix arcana.eval.generate --collection my-collection

Options

  • --sample-size - Number of chunks to sample (default: 50)
  • --source-id - Limit to chunks from specific source
  • --collection - Limit to chunks from specific collection

Configuration

Requires :repo and :llm to be configured in your application:

config :arcana,
  repo: MyApp.Repo,
  llm: my_llm_function