# MLflow

> AI evaluation and observability

Skills for evaluating agents, inspecting MLflow traces, debugging behavior, and building scorers.

## Profile stats

- Skills: 12
- Stars: 984
- Best skill: agent-evaluation

## Links

- HTML page: https://omgskills.com/library/mlflow/
- GitHub: https://github.com/mlflow
- X: https://x.com/MLflow

## Featured skills

- [agent-evaluation](https://omgskills.com/skills/mlflow/skills/agent-evaluation/index.md) — Use this when you need to EVALUATE OR IMPROVE or OPTIMIZE an existing LLM agent's output quality - including improving...
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [analyzing-mlflow-session](https://omgskills.com/skills/mlflow/skills/analyze-mlflow-chat-session/index.md) — Analyzes an MLflow session — a sequence of traces from a multi-turn chat conversation or interaction.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [analyzing-mlflow-trace](https://omgskills.com/skills/mlflow/skills/analyze-mlflow-trace/index.md) — Analyzes a single MLflow trace to answer a user query about it.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [build-a-scorer](https://omgskills.com/skills/mlflow/skills/build-a-scorer/index.md) — Help the user choose, create, iterate, or align MLflow judges and scorers for an agent, RAG app, LLM app, or GenAI...
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [debug-agent](https://omgskills.com/skills/mlflow/skills/debug-agent/index.md) — Root-causes AI agent failures from MLflow traces without requiring a code change, regression suite, scorer, or...
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [fix-agent-issue](https://omgskills.com/skills/mlflow/skills/fix-agent-issue/index.md) — Used to fix or change an AI agent's behavior using MLflow traces and regression tests.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [instrumenting-with-mlflow-tracing](https://omgskills.com/skills/mlflow/skills/instrumenting-with-mlflow-tracing/index.md) — Used to add or repair MLflow tracing in Python or TypeScript applications, including tracing required for evaluation.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [mlflow-agent](https://omgskills.com/skills/mlflow/skills/mlflow-agent/index.md) — Master dispatcher for all MLflow workflows.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [querying-mlflow-metrics](https://omgskills.com/skills/mlflow/skills/querying-mlflow-metrics/index.md) — Fetches aggregated trace metrics (token usage, latency, trace counts, quality evaluations) from MLflow tracking servers.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [retrieving-mlflow-traces](https://omgskills.com/skills/mlflow/skills/retrieving-mlflow-traces/index.md) — Retrieves MLflow traces using CLI or Python API.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [sagemaker-mlflow](https://omgskills.com/skills/mlflow/skills/sagemaker-mlflow/index.md) — Connect to SageMaker Managed MLflow (mlflow-app or mlflow-tracking-server ARN) as an MLflow backend, then hand off to...
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars
- [searching-mlflow-docs](https://omgskills.com/skills/mlflow/skills/searching-mlflow-docs/index.md) — Searches and retrieves MLflow documentation from the official docs site.
   - [@mlflow](https://omgskills.com/library/mlflow/index.md) · 82 stars

## Others you might like

- [Mobbin](https://omgskills.com/library/mobbin/index.md)
- [monday.com](https://omgskills.com/library/mondaycom/index.md)
- [Monta](https://omgskills.com/library/monta-app/index.md)