# airflow-dag-patterns

> Claude/Codex skill by [@wshobson](https://omgskills.com/library/wshobson/index.md) · 39k stars · Updated 2026-08-05

Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.

Tags: agent-skills, agentic-ai, agents, ai-agents, anthropic, automation, claude-code, claude-code-plugins, codex-cli, copilot, cursor, cursor-rules, developer-tools, gemini-cli, mcp, multi-agent, opencode, orchestration, prompt-engineering, workflows

## Install

```sh
git clone https://github.com/wshobson/agents /tmp/agents && ln -s /tmp/agents/plugins/data-engineering/skills/airflow-dag-patterns ~/.claude/skills/airflow-dag-patterns
```

## From README

Apache Airflow DAG Patterns Production-ready patterns for Apache Airflow including DAG design, operators, sensors, testing, and deployment strategies. When to Use This Skill Creating data pipeline orchestration with Airflow Designing DAG structures and dependencies Implementing custom operators and sensors Testing Airflow DAGs locally Setting up Airflow in production Debugging failed DAG runs Core Concepts DAG Design Principles | Principle | Description | | --------------- | ----------------------------------- | | Idempotent | Running twice produces same result | | Atomic | Tasks succeed or fail completely | | Incremental | Process only new/changed data | | Observable | Logs, metrics, alerts at every step | Task Dependencies Detailed patterns and worked examples Detailed pattern documentation lives in references/details.md. Read that file when the navigation tier above is insufficient.

## Links

- HTML page: https://omgskills.com/skills/wshobson/agents/airflow-dag-patterns/
- GitHub: https://github.com/wshobson/agents
- Author: [@wshobson](https://omgskills.com/library/wshobson/index.md)

## More from this repo

- [python-packaging](https://omgskills.com/skills/wshobson/agents/plugins/python-development/skills/python-packaging/index.md) — Used to create distributable Python packages with proper project structure, setup.py/pyproject.toml, and publishing to...
   - [@wshobson](https://omgskills.com/library/wshobson/index.md) · 39k stars
- [ai-debt-detector](https://omgskills.com/skills/wshobson/agents/plugins/skill-forge-essentials/skills/ai-debt-detector/index.md) — Use after generating code, after accepting AI suggestions, or when reviewing AI-written modules.
   - [@wshobson](https://omgskills.com/library/wshobson/index.md) · 39k stars
- [market-sizing-analysis](https://omgskills.com/skills/wshobson/agents/plugins/startup-business-analyst/skills/market-sizing-analysis/index.md) — Calculate TAM/SAM/SOM for market opportunities using top-down, bottom-up, and value theory methodologies.
   - [@wshobson](https://omgskills.com/library/wshobson/index.md) · 39k stars