Beamscope.Benchmark.Runner (Beamscope v0.1.0)

Copy Markdown View Source

Orchestrates one repo's benchmark: auto-discovers representative tasks (Beamscope.Benchmark.TaskDiscovery), measures the real "no beamscope" baseline (Beamscope.Benchmark.Baseline) against the real beamscope Beamscope.Repo output for each, counts real tokens (Beamscope.Benchmark.Tokenizer), and times both with Benchee for a repeatable latency comparison — the same methodology used for docs/search-benchmark-2026-07.md's manual benchmark, automated so it can be run again and again against any repo.

Summary

Functions

run(repo_path)

@spec run(String.t()) :: %{repo_path: String.t(), rows: [map()], timings: [map()]}