arize-prompt-optimization
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output quality, prompt engineering, prompt tuning, or system prompt improvement.
Install
With your agent
Install OMGSkills skill "arize-ai/arize-skills:arize-prompt-optimization" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/Arize-ai/arize-skills /tmp/arize-skills && ln -s /tmp/arize-skills/skills/arize-prompt-optimization ~/.claude/skills/arize-prompt-optimizationFrom README
Arize Prompt Optimization Skill SPACE — --space flags accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Confirm a known name with ax spaces get NAME; ax spaces list is for human browsing. Related skills arize-prompts: Create, version, and label prompts in Prompt Hub with ax prompts (JSON messages, providers, labels such as production). Use that skill when the artifact should live in Arize; use arize-prompt-optimization below to improve prompt text from traces, datasets, and experiments. Concepts Where Prompts Live in Trace Data LLM applications emit spans following OpenInference semantic conventions.
More from this repo
arize-instrumentation
Adds Arize AX tracing to an LLM application for the first time.
arize-admin
Manages Arize users, organizations, spaces, projects, roles, role bindings, resource restrictions, and API keys via the...
arize-ai-provider-integration
Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and...