# output-dev-eval-testing

> Claude/Codex skill by [@growthxai](https://omgskills.com/library/growthxai/index.md) · 443 stars · Updated 2026-10-22

Create offline evaluation tests for Output SDK workflows using @outputai/evals. Use when implementing test evaluators with verify(), creating dataset YAML files, building eval workflows, or running workflow tests via CLI.

Tags: agents, ai, ai-agents, ai-sdk, claude, claude-code, javascript, llm, nodejs, open-source, reliability, temporal, typescript, workflow-engine, workflows

## Install

```sh
git clone https://github.com/growthxai/output /tmp/output && ln -s /tmp/output/coding_assistants/claude/plugins/outputai/skills/output-dev-eval-testing ~/.claude/skills/output-dev-eval-testing
```

## From README

Offline Evaluation Testing Overview The @outputai/evals package provides an offline evaluation framework for testing workflow quality using datasets and evaluators. This is complementary to the runtime evaluator() from @outputai/core: | Aspect | Runtime Evaluators (@outputai/core) | Offline Eval Tests (@outputai/evals) | |--------|----------------------------------------|------------------------------------------| | When | During workflow execution | After execution, at test time | | Where | evaluators.ts in workflow folder | tests/evals/ in workflow folder | | Purpose | Live quality scoring with confidence | Dataset-driven pass/fail verification | | Triggered by | Workflow orchestration | output workflow test CLI command | | Returns | EvaluationBooleanResult, etc. | Verdict helpers (pass/partial/fail) | Use offline eval testing when you want to validate workflow behavior against known datasets, build regression test suites, or assess subjective quality with LLM judges.

## Links

- HTML page: https://omgskills.com/library/growthxai/output/coding_assistants/claude/plugins/outputai/skills/output-dev-eval-testing/
- GitHub: https://github.com/growthxai/output
- Author: [@growthxai](https://omgskills.com/library/growthxai/index.md)

## More from this repo

- [output-build-workflow](https://omgskills.com/library/growthxai/output/coding_assistants/claude/plugins/outputai/skills/output-build-workflow/index.md) — Implement an Output SDK workflow from a plan document.
   - [@growthxai](https://omgskills.com/library/growthxai/index.md) · 443 stars
- [output-credentials-edit](https://omgskills.com/library/growthxai/output/coding_assistants/claude/plugins/outputai/skills/output-credentials-edit/index.md) — View, edit, and set encrypted credentials in an Output.ai project.
   - [@growthxai](https://omgskills.com/library/growthxai/index.md) · 443 stars
- [output-credentials-env-vars](https://omgskills.com/library/growthxai/output/coding_assistants/claude/plugins/outputai/skills/output-credentials-env-vars/index.md) — Wire encrypted credentials to environment variables using the credential: convention.
   - [@growthxai](https://omgskills.com/library/growthxai/index.md) · 443 stars