# datahub-evals

> Claude/Codex skill by [@datahub-project](https://omgskills.com/library/datahub-project/index.md) · 45 stars · Updated 2026-09-29

Use this skill to run DataHub's saved evals and report answers for judging. Triggers on: "run our evals", "run the eval suite", "run eval urn:li:eval:...", "how are our evals doing", "check for eval regressions", "upload this answer as an eval result", "score this answer with the DataHub judge", "compare two agents on the same eval". Answers each eval in a fresh agent with the DataHub tools attached, reports the answer through the DataHub Cloud CLI, and reads back the verdict DataHub's own judge produced.

## Install

```sh
git clone https://github.com/datahub-project/datahub-skills /tmp/datahub-skills && ln -s /tmp/datahub-skills/skills/datahub-evals ~/.claude/skills/datahub-evals
```

## From README

DataHub Evals Run DataHub's saved evals, and report answers — yours or another agent's — for DataHub to judge. You are the runner. There is no script: you fetch the evals, answer each one in a fresh agent, and report the answers. Every call to DataHub is one evals subcommand, so the queries and the payload live in the CLI. Use acryl-datahub-cloud evals. A datahub evals form exists in the CLI's own help text and in some notes, but the group is not wired into the datahub CLI in any shipped release — that name answers No such command 'evals', and this skill does not use it. --- Never simulate the judge If DataHub's judge cannot be reached, say so and stop. Do not score the answer yourself, do not ask a subagent to render a verdict "the way DataHub would", and do not present any locally-produced score as a verdict. A simulated verdict written in the house style reads as authoritative, gets pasted into a comparison table, and is comparable with nothing.

## Links

- HTML page: https://omgskills.com/library/datahub-project/datahub-skills/skills/datahub-evals/
- GitHub: https://github.com/datahub-project/datahub-skills
- Author: [@datahub-project](https://omgskills.com/library/datahub-project/index.md)

## More from this repo

- [datahub-mfe-configure-app](https://omgskills.com/library/datahub-project/datahub-skills/skills/datahub-mfe-configure-app/index.md) — Configure a DataHub instance to load and display a Micro Frontend (MFE) app.
   - [@datahub-project](https://omgskills.com/library/datahub-project/index.md) · 45 stars
- [datahub-mfe-create-app](https://omgskills.com/library/datahub-project/datahub-skills/skills/datahub-mfe-create-app/index.md) — Scaffold a new DataHub Micro Frontend (MFE) app with all boilerplate files.
   - [@datahub-project](https://omgskills.com/library/datahub-project/index.md) · 45 stars
- [datahub-sql-workflow](https://omgskills.com/library/datahub-project/datahub-skills/skills/datahub-sql-workflow/index.md) — Ground text-to-SQL work in DataHub catalog evidence.
   - [@datahub-project](https://omgskills.com/library/datahub-project/index.md) · 45 stars