diffbot-crawl
Crawl a website or manage Diffbot crawler jobs. Use when the user wants to crawl a site for structured content, list existing crawl jobs, or delete a crawl job. Triggers on: crawl website, crawl site, crawler job, list crawl jobs, delete crawl job, diffbot crawl.
Install
With your agent
Install OMGSkills skill "diffbot/diffbot-skills:skills/diffbot-crawl" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/diffbot/diffbot-skills /tmp/diffbot-skills && ln -s /tmp/diffbot-skills/skills/diffbot-crawl ~/.claude/skills/diffbot-crawlFrom README
Diffbot Crawler Crawl websites for structured content via the Diffbot Crawlbot API, and manage crawler jobs. The db crawl CLI commands Always invoke with the fixed path /.diffbot/venv/bin/db.
More from this repo
diffbot-deals
Used to search funding rounds, investments, and acquisitions in the Diffbot Knowledge Graph by date, deal size, round...
diffbot-dql
Query the Diffbot Knowledge Graph directly with DQL (Diffbot Query Language).
diffbot-entities
Identify and resolve named entities in text using the Diffbot NLP API.