OfficialLocal + RemoteFree server, account needed

Octocrawl MCP server

77777R7/Octocrawl

Web scraping for AI agents: scrape, map, crawl and batch public pages into Markdown, tables and JSON, each with an Evidence Record (final URL, HTTP status, robots.txt decision, content hashes); a blocked or empty page comes back with the reason. Hosted at https://mcp.octocrawl.dev/mcp or local via npx -y @octocrawl/mcp. Setup.

2 GitHub stars

Install Octocrawl in Claude Code

Remote URL

Claude Code
claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp
mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)
{
  "mcpServers": {
    "octocrawl": {
      "url": "https://mcp.octocrawl.dev/mcp"
    }
  }
}

npm

Claude Code
claude mcp add octocrawl -- npx -y @octocrawl/mcp
mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)
{
  "mcpServers": {
    "octocrawl": {
      "command": "npx",
      "args": [
        "-y",
        "@octocrawl/mcp"
      ]
    }
  }
}

Frequently asked questions

What does the Octocrawl MCP server do?

Web scraping for AI agents: scrape, map, crawl and batch public pages into Markdown, tables and JSON, each with an Evidence Record (final URL, HTTP status, robots.txt decision, content hashes); a blocked or empty page comes back with the reason. Hosted at https://mcp.octocrawl.dev/mcp or local via npx -y @octocrawl/mcp. Setup.

Is the Octocrawl MCP server free?

The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.

Does Octocrawl run locally or remotely?

Local + Remote. Can run locally or be used as a hosted remote server.

How do I add Octocrawl to Claude Code?

Run: claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp

More browser automation MCP servers

View all