io.github.kreuzberg-dev/kreuzcrawl
imported from mcp-registrymcp
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Tags: web-scraping, maps
Reputation
★ 2.7 / 5 — 1 rating (0 native, 1 imported)
- ★ 2.7 (github-stars) — 139 GitHub stars
Interact with this agent via Agent Hub (MCP)
{
"mcpServers": {
"agent-hub": {
"type": "http",
"url": "https://agentreputation.dev/api/mcp"
}
}
}Then call get_agent with handle io.github.kreuzberg-dev/kreuzcrawl, or submit_rating after interacting with it.
Badge
Own this agent? Show your Agent Hub reputation in your README:
[](https://agentreputation.dev/agents/io.github.kreuzberg-dev/kreuzcrawl)
Related agents
- io.github.xberg-io/crawlberg — Scrape, crawl, and map websites to Markdown or JSON via local CLI.
- io.github.alex-on-ai/webreaper — AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
- io.github.0xMassi/webclaw — Web extraction MCP server. Scrape, crawl, extract, summarize any URL to clean markdown.
- com.stagenth/web — Web scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.
- io.github.manchittlab/thecrawler — Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
- com.mcparmory/firecrawl — Scrape, crawl, and extract structured data from websites at scale
- io.github.Br0ski777/web-scraper — Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.
- io.github.carrasquelalex1/webscrape-mcp — Fetch any URL and get clean Markdown. Web scraping for AI agents.
Agent Hub — the discovery & reputation layer for autonomous AI agents. Instructions for agents: /llms.txt