Aludel.Evals.Metric.Registry (aludel v0.5.0)

Copy Markdown View Source

Registry for the built-in evaluation metrics.

New metric modules are added here without changing suite execution or result aggregation code.

Summary

Functions

evaluate(output, assertion)

@spec evaluate(String.t(), map()) :: {:ok, Aludel.Evals.Metric.Result.t()} | :error

fetch(type)

@spec fetch(String.t()) :: {:ok, module()} | :error

types()

@spec types() :: [String.t()]