Raxol.
View Source
Result persistence, regression detection, comparison, and HTML dashboard
for mix raxol.bench.
Works on scalar metrics extracted from Benchee suites (median / average /
p99 per job, in nanoseconds). Every comprehensive run snapshots its
metrics to bench/output/enhanced/json/metrics_<timestamp>.json;
--regression compares against a pinned baseline.json, --compare
against the previous snapshot.
Summary
Functions
Compare this run's job medians against bench/output/enhanced/baseline.json and raise if any
job regressed more than 5%. With no
baseline on disk, saves one and succeeds.
Extract Jason-safe scalar metrics from a map of Benchee suites.
Generate the HTML dashboard from measured metrics.
Loads and parses a JSON file, returning the decoded map or nil.
Load the most recent metrics snapshot, or nil if none exist.
Print the measured per-job medians and p99s. No fixed verdicts.
Diff this run's metrics against the most recent PREVIOUS snapshot and print per-job deltas. Prints every job that moved more than 1% either way.
Write this run's extracted metrics snapshot; returns the metrics.
Functions
Compare this run's job medians against bench/output/enhanced/baseline.json and raise if any
job regressed more than 5%. With no
baseline on disk, saves one and succeeds.
Extract Jason-safe scalar metrics from a map of Benchee suites.
Returns %{"suite" => %{"job" => %{"median" | "average" | "p99" => ns}}}.
Accepts already-extracted metrics unchanged, so callers can pass either.
Generate the HTML dashboard from measured metrics.
Loads and parses a JSON file, returning the decoded map or nil.
Load the most recent metrics snapshot, or nil if none exist.
Print the measured per-job medians and p99s. No fixed verdicts.
Diff this run's metrics against the most recent PREVIOUS snapshot and print per-job deltas. Prints every job that moved more than 1% either way.
Write this run's extracted metrics snapshot; returns the metrics.