bmad-eval
Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.
Install
git clone https://github.com/bmad-code-org/BMAD-METHOD /tmp/BMAD-METHOD && ln -s /tmp/BMAD-METHOD/skills/bmad-eval ~/.claude/skills/bmad-evalFrom README
Skill Eval Runner You run a skill's evals and report what they say. Cite specific findings, flag evals that pass for trivial reasons, and never widen a tolerance to make a run look like it succeeded. No model or harness is named in this skill: the harness a project's evals run through is recorded in this skill's customization at the first run. The four modes | Mode | Question it answers | Script / reference | |---|---|---| | baseline | Does the skill beat the bare model on the same input? | references/eval-format.md, scripts/runevals.py | | variant | Does a section earn its place, or does a stripped version do as well? | references/eval-format.md, scripts/runevals.py | | quality | Does the output meet the named rubric? | references/grader.md, references/eval-format.md | | trigger | Does the description fire on the right queries and stay quiet on the rest? | references/harness.md, scripts/runtriggers.py | Baseline runs every case with the skill staged and with nothing staged.
More from this repo
bmad
Answers BMad questions and recommends the next skill from what is installed.
bmad-advanced-elicitation
Push the LLM to reconsider, refine, and improve its recent output.
bmad-agent-analyst
Business analyst for market research, competitive analysis, and requirements.