# scrape

> Claude/Codex skill by [@brightdata](https://omgskills.com/library/brightdata/index.md) · 266 stars · Updated 2026-10-15

Scrape web content as clean markdown/HTML/JSON via the Bright Data CLI (\`bdata scrape\`). Use when the user wants to fetch a page, extract content from a list of URLs, or crawl paginated listings. Hands off to \`data-feeds\` for supported platforms (Amazon, LinkedIn, TikTok, Instagram, YouTube, Reddit, etc.) and to \`search\` when URLs must be discovered first. Requires the Bright Data CLI; proactively guides install + login if missing.

## Install

```sh
git clone https://github.com/brightdata/skills /tmp/skills && ln -s /tmp/skills/skills/scrape ~/.claude/skills/scrape
```

## From README

Bright Data — Scrape Get clean content (markdown, HTML, JSON, screenshot) from one or more URLs via the Bright Data CLI. This skill owns the "fetch raw or lightly-structured content" job. For platform-specific structured data (Amazon, LinkedIn, TikTok, etc.), stop and use data-feeds instead — you'll get clean JSON without selector logic. gate (run first) Before any scrape, verify the CLI is installed and authenticated: If either check fails, halt and route the user to skills/bright-data-best-practices/references/cli- .md. Do not attempt the legacy curl fallback silently — ask the user first.

## Links

- HTML page: https://omgskills.com/library/brightdata/skills/scrape/
- GitHub: https://github.com/brightdata/skills
- Author: [@brightdata](https://omgskills.com/library/brightdata/index.md)

## More from this repo

- [agent-onboarding](https://omgskills.com/library/brightdata/skills/agent-onboarding/index.md) — The entry point to all Bright Data skills - start here, and it guides the agent to the right skill for the task at hand...
   - [@brightdata](https://omgskills.com/library/brightdata/index.md) · 271 stars
- [brd-browser-debug](https://omgskills.com/library/brightdata/skills/skills/brd-browser-debug/index.md) — Used to debug Bright Data Scraping Browser sessions using the Browser Sessions API.
   - [@brightdata](https://omgskills.com/library/brightdata/index.md) · 268 stars
- [bright-data-mcp](https://omgskills.com/library/brightdata/skills/bright-data-mcp/index.md) — Bright Data MCP handles ALL web data operations.
   - [@brightdata](https://omgskills.com/library/brightdata/index.md) · 268 stars