Install Web Crawler MCP by InsightfulPipe in Claude Code
claude mcp add --transport http web-crawler-mcp-by-insightfulpipe https://crawler.insightfulmcp.com/{
"mcpServers": {
"web-crawler-mcp-by-insightfulpipe": {
"url": "https://crawler.insightfulmcp.com/"
}
}
}Frequently asked questions
What does the Web Crawler MCP by InsightfulPipe MCP server do?
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
Is the Web Crawler MCP by InsightfulPipe MCP server free?
The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.
Does Web Crawler MCP by InsightfulPipe run locally or remotely?
Remote. Hosted by the provider. You connect with a URL, nothing to install.
How do I add Web Crawler MCP by InsightfulPipe to Claude Code?
Run: claude mcp add --transport http web-crawler-mcp-by-insightfulpipe https://crawler.insightfulmcp.com/
More search & web scraping MCP servers
View allWeb Scan
ankitkumarjha515/web-scan
Audit any live URL: 85 SEO, AI-search, security, leaked-key and speed checks, with fixes to verify.
Web Access Gateway
dev.workers.mattskowronis.web-access-gateway/web-access
Paid web, news, company, product, and geographic search plus clean page reading for agents.
Web Search API for all your agents and LLMs
ai.blopus/search
Live web search, image search, topic filters and full-text fetch over our own crawled index.
WearableDocs
com.wearabledocs/wearabledocs
Refusal of anatomical gift in 50 states and DC, plus the WearableDocs FAQ, products, prices, search.
Web Tools
org.echoempire/web-tools
Web extraction MCP: page content, metadata, articles, contacts, email checks, URL probes.
Waysmith Advisor
io.waysmith/advisor
Fit-first college search and list-building. Research culture, real costs and odds for 400+ colleges.