Install Crawl Census in Claude Code
claude mcp add --transport http crawl-census https://crawlcensus.com/mcp{
"mcpServers": {
"crawl-census": {
"url": "https://crawlcensus.com/mcp"
}
}
}Frequently asked questions
What does the Crawl Census MCP server do?
Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?
Is the Crawl Census MCP server free?
The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.
Does Crawl Census run locally or remotely?
Remote. Hosted by the provider. You connect with a URL, nothing to install.
How do I add Crawl Census to Claude Code?
Run: claude mcp add --transport http crawl-census https://crawlcensus.com/mcp
More search & web scraping MCP servers
View allCrawl4Agent
com.saastemly/crawl4agent
crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
Cralo
amrnth/opentooler
Pay-per-use tool marketplace for AI agents. Search, price-check, and call APIs via MCP.
CrawlCheck
emmanuelorta/crawlcheck-core
Verification layer for the agentic web: a signed answer about any site before an agent acts.
Craigslist Scraper & Tracker (cars, housing)
io.github.akhilrajesh213/craigslist-scraper
Craigslist listings for AI agents: search by keyword, city, state and category; cars, rentals.
Crawlinx
im-ff/crawlinx-mcp
Free technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report.
Crafting Step by Step
com.craftingstepbystep/tutorials
Search and cite step-by-step papercraft and craft tutorials with tools, supplies, and video credit.