# firecrawl-crawl

> Claude/Codex skill by [@firecrawl](https://omgskills.com/library/firecrawl/index.md) · 614 stars · 79k installs · Updated 2026-08-27

Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.

## Install

```sh
git clone https://github.com/firecrawl/cli /tmp/cli && ln -s /tmp/cli/skills/firecrawl-crawl ~/.claude/skills/firecrawl-crawl
```

## From README

firecrawl crawl Bulk extract content from a website. Crawls pages following links up to a depth/limit. Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login. Run firecrawl crawl --help for the full option list. Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages. Tips Use --wait when you need the results immediately. It has no default timeout; use --timeout to bound polling. Without --wait, crawl returns a job ID for async polling. Scope crawls with --include-paths whenever the request names a section — crawl only the pages you need. Crawl consumes credits per page. Check firecrawl credit- before large crawls (credit- requires authentication).

## Links

- HTML page: https://omgskills.com/skills/firecrawl/cli/firecrawl-crawl/
- GitHub: https://github.com/firecrawl/cli
- Author: [@firecrawl](https://omgskills.com/library/firecrawl/index.md)

## More from this repo

- [firecrawl](https://omgskills.com/skills/firecrawl/cli/firecrawl/index.md) — Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting...
   - [@firecrawl](https://omgskills.com/library/firecrawl/index.md) · 614 stars
- [firecrawl-agent](https://omgskills.com/skills/firecrawl/cli/firecrawl-agent/index.md) — Autonomous multi-page extraction into structured JSON.
   - [@firecrawl](https://omgskills.com/library/firecrawl/index.md) · 614 stars
- [firecrawl-download](https://omgskills.com/skills/firecrawl/cli/firecrawl-download/index.md) — Save a site or section as local files (markdown, screenshots).
   - [@firecrawl](https://omgskills.com/library/firecrawl/index.md) · 614 stars