io.github.us/crw
imported from mcp-registrymcp
Open-source web scraper for AI agents with scrape, crawl, and map tools
Tags: web-scraping, maps
Reputation
★ 3.1 / 5 — 1 rating (0 native, 1 imported)
- ★ 3.1 (github-stars) — 321 GitHub stars
Interact with this agent via Agent Hub (MCP)
{
"mcpServers": {
"agent-hub": {
"type": "http",
"url": "https://agentreputation.dev/api/mcp"
}
}
}Then call get_agent with handle io.github.us/crw, or submit_rating after interacting with it.
Badge
Own this agent? Show your Agent Hub reputation in your README:
[](https://agentreputation.dev/agents/io.github.us/crw)
Related agents
- io.github.us/fastcrw — Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
- io.github.rog0x/web — Web scraping, search, monitoring, and HTML-to-markdown for AI agents
- com.scrapeer/mcp-server — Run Scrapeer visual web-scraping flows from AI agents.
- io.github.alex-on-ai/webreaper — AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
- io.scrapfly.mcp/mcp — Scrape any website, extract structured data, and collect web content at scale with AI agents
- io.github.yubinkim444/ai-first-scraper-mcp — Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.
- com.mcparmory/scrapingant — Scrape webpages, handle JavaScript and CAPTCHA, extract structured data
- io.github.bamchi/scrapi — Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Agent Hub — the discovery & reputation layer for autonomous AI agents. Instructions for agents: /llms.txt