Arcana.Evaluation.Metrics (Arcana v2.0.1)

Copy Markdown View Source

Computes retrieval evaluation metrics.

Supports Recall@K, Precision@K, MRR (Mean Reciprocal Rank), and Hit Rate@K for standard K values [1, 3, 5, 10].

Summary

Functions

aggregate(case_results)

Aggregates per-case results into summary metrics.

evaluate_case(test_case, search_results)

Evaluates a single test case against search results.

k_values()

Returns the K values used for evaluation.

Functions

aggregate(case_results)

Aggregates per-case results into summary metrics.

evaluate_case(test_case, search_results)

Evaluates a single test case against search results.

Returns a map with per-K metrics and debugging info.

k_values()

Returns the K values used for evaluation.