mix pixir.bench.fanout_gauntlet (pixir v0.1.5)

Copy Markdown View Source

Runs a bounded fanout regression gauntlet for direct Pixir CLI fanout and parent-led Subagent fanout.

This is a correctness gate, not a performance benchmark. It is designed to expose false success, missing terminal evidence, hidden failures, and misleading parent-led fanout outcomes.

Usage:

mix pixir.bench.fanout_gauntlet --dry-run --json
mix pixir.bench.fanout_gauntlet --json
mix pixir.bench.fanout_gauntlet --mode direct --pixir-bin ./pixir --direct-n 3
mix pixir.bench.fanout_gauntlet --mode parent --parent-n 4 --timeout-ms 500

Artifacts:

direct_runs.jsonl
parent_runs.jsonl
summary.json
report.md
completion_audit.json

Direct mode launches safe, no-network Pixir CLI commands (--version, doctor --json, and help). Parent-led mode uses Pixir's in-process Subagent seam with fake providers, including one intentional timeout fixture whose success criterion is honest partial evidence rather than all-green completion.