firecrawl-crawl
Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.
Install
git clone https://github.com/firecrawl/cli /tmp/cli && ln -s /tmp/cli/skills/firecrawl-crawl ~/.claude/skills/firecrawl-crawlFrom README
firecrawl crawl Bulk extract content from a website. Crawls pages following links up to a depth/limit. Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login. Run firecrawl crawl --help for the full option list. Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages. Tips Use --wait when you need the results immediately. It has no default timeout; use --timeout to bound polling. Without --wait, crawl returns a job ID for async polling. Scope crawls with --include-paths whenever the request names a section — crawl only the pages you need. Crawl consumes credits per page. Check firecrawl credit- before large crawls (credit- requires authentication).
More from this repo
firecrawl
Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting...
firecrawl-agent
Autonomous multi-page extraction into structured JSON.
firecrawl-download
Save a site or section as local files (markdown, screenshots).