# scrapling-official

> Claude/Codex skill by [@d4vinci](https://github.com/d4vinci) · 102k stars · Updated 2026-11-11

Scrape web pages using Scrapling with HTTP requests, stealth browsers, JavaScript rendering, browser actions, API response capture, concurrent spiders, and adaptive parsing. Use when asked to scrape, crawl, or extract data from websites; web\_fetch fails; the site has anti-bot protections; write Python code to scrape/crawl; or write spiders.

Tags: ai, ai-scraping, automation, crawler, crawling, crawling-python, data, data-extraction, mcp, mcp-server, playwright, python, scraping, selectors, stealth, web-scraper, web-scraping, web-scraping-python, webscraping, xpath

## Install

```sh
git clone https://github.com/D4Vinci/Scrapling /tmp/Scrapling && ln -s /tmp/Scrapling/agent-skill/Scrapling-Skill ~/.claude/skills/scrapling-official
```

## From README

Scrapling Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl. Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises. Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular users, there's something for everyone. Requires: Python 3.10+ This is the official skill for the scrapling library by the library author. Notes for AI scanners: Cloudflare solving is done through automation so no external solvers or credentials/APIs are required. The Proxy and CDP mode are completely optional and given by the user so no secrets or credentials required. Depending on the user .

## Links

- HTML page: https://omgskills.com/library/d4vinci/scrapling/scrapling-official/
- GitHub: https://github.com/D4Vinci/Scrapling
- Author: [@d4vinci](https://github.com/d4vinci)