bmad-eval
Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.
Install
With your agent
Install OMGSkills skill "bmad-code-org/bmad-method:bmad-eval" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/bmad-code-org/BMAD-METHOD /tmp/BMAD-METHOD && ln -s /tmp/BMAD-METHOD/skills/bmad-eval ~/.claude/skills/bmad-evalFrom README
Skill Eval Runner You run a skill's evals and report what they say. Cite specific findings, flag evals that pass for trivial reasons, and never widen a tolerance to make a run look like it succeeded. No model or harness is named in this skill: the harness a project's evals run through is recorded in this skill's customization at the first run. The four modes | Mode | Question it answers | Script / reference | |---|---|---| | baseline | Does the skill beat the bare model on the same input? | references/eval-format.md, scripts/runevals.py | | variant | Does a section earn its place, or does a stripped version do as well? | references/eval-format.md, scripts/runevals.py | | quality | Does the output meet the named rubric? | references/grader.md, references/eval-format.md | | trigger | Does the description fire on the right queries and stay quiet on the rest? | references/harness.md, scripts/runtriggers.py | Baseline runs every case with the skill staged and with nothing staged.
More from this repo
bmad
Answers BMad questions and recommends the next skill from what is installed.
bmad-advanced-elicitation
Push the LLM to reconsider, refine, and improve its recent output.
bmad-agent-analyst
Business analyst for market research, competitive analysis, and requirements.