firecrawl-crawl
Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.
Install
With your agent
Install OMGSkills skill "firecrawl/firecrawl-cli:firecrawl-crawl" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/firecrawl/cli /tmp/cli && ln -s /tmp/cli/skills/firecrawl-crawl ~/.claude/skills/firecrawl-crawlFrom README
firecrawl crawl Bulk extract content from a website. Crawls pages following links up to a depth/limit. Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login. Run firecrawl crawl --help for the full option list. Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages. Tips Use --wait when you need the results immediately. It has no default timeout; use --timeout to bound polling. Without --wait, crawl returns a job ID for async polling. Scope crawls with --include-paths whenever the request names a section — crawl only the pages you need. Crawl consumes credits per page. Check firecrawl credit- before large crawls (credit- requires authentication).
More from this repo
firecrawl
Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting...
firecrawl-agent
Autonomously navigate websites and extract structured data across pages.
firecrawl-download
Save a site or section as local files (markdown, screenshots).