mix temper.report (temper v0.2.0)

Copy Markdown View Source

Reports flaky tests: tests with divergent outcomes on the same git SHA.

$ mix temper.report

Reads every .temper/history-*.jsonl file (all partitions), runs the flake analysis and prints flaky tests sorted by flake rate, followed by lower-confidence suspects (divergence involving dirty-tree runs).

The task always exits 0 — it informs, it does not gate CI.

Options

  • --json — print a machine-readable JSON payload instead (every finding carries a derived "app" field)
  • --by-app — group findings by umbrella child app (derived from file paths), with per-app counts and involved files
  • --min-runs N — minimum runs on a SHA for its divergence to count as evidence (default: 2)
  • --history GLOB — read this path or glob instead of the default (also configurable with config :temper, history_path: "...")