scrape
Scrape web content as clean markdown/HTML/JSON via the Bright Data CLI (`bdata scrape`). Use when the user wants to fetch a page, extract content from a list of URLs, or crawl paginated listings. Hands off to `data-feeds` for supported platforms (Amazon, LinkedIn, TikTok, Instagram, YouTube, Reddit, etc.) and to `search` when URLs must be discovered first. Requires the Bright Data CLI; proactively guides install + login if missing.
Install
With your agent
Install OMGSkills skill "brightdata/skills:scrape" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/brightdata/skills /tmp/skills && ln -s /tmp/skills/skills/scrape ~/.claude/skills/scrapeFrom README
Bright Data — Scrape Get clean content (markdown, HTML, JSON, screenshot) from one or more URLs via the Bright Data CLI. This skill owns the "fetch raw or lightly-structured content" job. For platform-specific structured data (Amazon, LinkedIn, TikTok, etc.), stop and use data-feeds instead — you'll get clean JSON without selector logic. gate (run first) Before any scrape, verify the CLI is installed and authenticated: If either check fails, halt and route the user to skills/bright-data-best-practices/references/cli- .md. Do not attempt the legacy curl fallback silently — ask the user first.
More from this repo
agent-onboarding
The entry point to all Bright Data skills - start here, and it guides the agent to the right skill for the task at hand...
brd-browser-debug
Used to debug Bright Data Scraping Browser sessions using the Browser Sessions API.
bright-data-mcp
Bright Data MCP handles ALL web data operations.