batch
Scrape up to 10,000 URLs in a single batch operation using Olostep
Install
With your agent
Install OMGSkills skill "olostep/olostep-claude-code-plugin:skills/batch" into this agent's normal skills directory: call the OMGSkills MCP get_install_plan tool for your agent and run the script it returns (it installs only the pinned commit and verifies SKILL.md), and stop if MCP or the pin is unavailable. Do not overwrite or change existing skills without asking me.
Manual command
git clone https://github.com/olostep/olostep-claude-code-plugin /tmp/olostep-claude-code-plugin && ln -s /tmp/olostep-claude-code-plugin/skills/batch ~/.claude/skills/batchFrom README
Olostep Batch Scrape Scrape up to 10,000 URLs at once with Olostep's batch processing API. Perfect for large-scale data extraction. Instructions When the user wants to batch scrape multiple URLs (via $ARGUMENTS or in conversation): Collect the list of URLs from the user. Use the mcpolostepbatchscrapeurls tool with the URL array. Default to markdown output format unless specified. Each URL can have an optional customid for tracking.
More from this repo
answers
Get AI-powered answers with citations and sources from the web using Olostep
crawl
Autonomously crawl an entire website starting from a URL, following links to discover and scrape pages
debug-error
Used to search the live web for a specific error message and find the real fix — from GitHub issues, StackOverflow, or...