arize-prompt-optimization
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output quality, prompt engineering, prompt tuning, or system prompt improvement.
Install
git clone https://github.com/Arize-ai/arize-skills /tmp/arize-skills && ln -s /tmp/arize-skills/skills/arize-prompt-optimization ~/.claude/skills/arize-prompt-optimizationFrom README
Arize Prompt Optimization Skill SPACE — --space flags accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Confirm a known name with ax spaces get NAME; ax spaces list is for human browsing. Related skills arize-prompts: Create, version, and label prompts in Prompt Hub with ax prompts (JSON messages, providers, labels such as production). Use that skill when the artifact should live in Arize; use arize-prompt-optimization below to improve prompt text from traces, datasets, and experiments. Concepts Where Prompts Live in Trace Data LLM applications emit spans following OpenInference semantic conventions.
More from this repo
arize-admin
Manages Arize users, organizations, spaces, projects, roles, role bindings, resource restrictions, and API keys via the...
arize-ai-provider-integration
Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and...
arize-annotation
Creates and manages annotation configs (categorical, continuous, freeform label schemas) and annotation queues (human...