Install Crawlforge in Claude Code
claude mcp add crawlforge -e CRAWLFORGE_API_KEY=... -- npx -y crawlforge-mcp-server{
"mcpServers": {
"crawlforge": {
"command": "npx",
"args": [
"-y",
"crawlforge-mcp-server"
],
"env": {
"CRAWLFORGE_API_KEY": "..."
}
}
}
}Replace each ... with your own value.
Frequently asked questions
What does the Crawlforge MCP server do?
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
Is the Crawlforge MCP server free?
The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.
Does Crawlforge run locally or remotely?
Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.
How do I add Crawlforge to Claude Code?
Run: claude mcp add crawlforge -e CRAWLFORGE_API_KEY=... -- npx -y crawlforge-mcp-server
More search & web scraping MCP servers
View allSkillmd
skillmds/skillmd
Search, fetch, lint, and install Agent Skills (SKILL.md) from the SkillMD registry.
Meilisearch
meilisearch/meilisearch-mcp
Interact & query with Meilisearch (Full-text & semantic search API)
Keyline Icons
keyline-icons/keyline-icons
Search Keyline Icons by name and get any icon's SVG source or React import. No key, no network.
Simple Arxiv
andybrandt/mcp-simple-arxiv
Search and read papers from arXiv.
Scrapeless
scrapeless-ai/scrapeless-mcp-server
Integrate real-time Scrapeless Google SERP(Google Search, Google Flight, Google Map, Google Jobs....) results into your LLM applications. This server enables dynamic context retrieval for AI workflows, chatbots, and research tools.
jDocmunch
jgravelle/jdocmunch-mcp
Section-level doc search for .md, .rst, .adoc, .ipynb, .html, .yaml, .json, and OpenAPI specs.