bootstrap-realtime-eval
Bootstrap a new realtime eval folder inside this cookbook repo by choosing the right harness from examples/evals/realtime_evals, scaffolding prompt/tools/data files, generating a useful README, and validating it with smoke, full eval, and test runs. Use when a user wants to start a new crawl, walk, or run realtime eval in this repository.
Install
Install this Claude and Codex skill with the command below. The command stays visible even when copy support is unavailable.
git clone https://github.com/openai/openai-cookbook /tmp/openai-cookbook && ln -s /tmp/openai-cookbook/examples/evals/realtime_evals/skills/bootstrap-realtime-eval ~/.claude/skills/bootstrap-realtime-evalFrom README
Bootstrap Realtime Eval Use this skill when the user wants a new realtime eval scaffold under examples/evals/realtimeevals/. This skill is repo-specific. Do not copy harness code into the generated folder. The generated eval should point at the shared harnesses already in: examples/evals/realtimeevals/crawlharness examples/evals/realtimeevals/walkharness examples/evals/realtimeevals/runharness Inputs To Collect Always ask the user for the minimum set needed to choose and scaffold the eval before you create files, run the scaffold script, or author starter data. Do not skip this just because you can infer a default. Ask for: Eval name Goal or scenario Harness choice, or enough context to recommend one System prompt path or inline text Tools JSON path or tool descriptions Data path or source materials Desired graders If the user does not know which harness they want, explain the options briefly and recommend one. See references/harness-selection.md.
More skills
babysit-pr
Babysit a GitHub pull request after creation by continuously polling review comments, CI checks/workflow runs, and...
code-review-change-size
Change size guidance (800 lines)
plugin-creator
Used to create and scaffold plugin directories for Codex with a required `.codex-plugin/plugin.json`, optional plugin...