Install Webcrawl in Claude Code
This server doesn't publish a package to a registry, so follow the install steps in its README. Once it runs, register it with Claude Code:
claude mcp add pragmar-webcrawl -- <command to start the server>Frequently asked questions
What does the Webcrawl MCP server do?
Search and retrieve web crawler data from WARC, wget, Katana, SiteOne and InterroBot crawls.
Is the Webcrawl MCP server free?
Yes, most likely. Open source and no paid account or API key is mentioned in the listing. Check the provider for current pricing.
Does Webcrawl run locally or remotely?
Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.
How do I add Webcrawl to Claude Code?
Follow the install steps in the project's README at https://github.com/pragmar/mcp-server-webcrawl, then register it with "claude mcp add".
More search & web scraping MCP servers
View allBilibili
XZXZZX-Ai/bilibili-mcp
Local-first Bilibili MCP server for video metadata, subtitles and structured transcripts, chapters, popular comments, and optional local ASR fallback. Published on npm as @xzxzzx/bilibili-mcp with bilingual documentation.
NeuroStack
raphasouthall/neurostack
Token-efficient MCP memory for Markdown vaults. Tiered search, GraphRAG, AI memories.
Adam
strangeadvancedmarketing/Adam
Persistent memory tools for Claude Desktop. Search your vault or Obsidian notes mid-conversation.
Companies House
aicayzer/companies-house-mcp
UK Companies House public register: search companies, officers, ownership, filings and documents.
Alive Analysis
with-geun/alive-analysis
Query alive-analysis history from any AI client. Tools: list, get, search, dashboard export.
brain
debashishthakur/brain-mcp
Your Obsidian vault as private, searchable memory for Claude, Cursor, Hermes and any MCP client