RemoteFree

Online Web Directory MCP server

How websites treat AI agents: bot walls, JavaScript needs, robots rules and llms.txt, before you fetch.

Install Online Web Directory in Claude Code

Claude Code
claude mcp add --transport http online-web-directory https://onlinewebdirectory.net/mcp
mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)
{
  "mcpServers": {
    "online-web-directory": {
      "url": "https://onlinewebdirectory.net/mcp"
    }
  }
}

Frequently asked questions

What does the Online Web Directory MCP server do?

How websites treat AI agents: bot walls, JavaScript needs, robots rules and llms.txt, before you fetch.

Is the Online Web Directory MCP server free?

Yes, most likely. Open source and no paid account or API key is mentioned in the listing. Check the provider for current pricing.

Does Online Web Directory run locally or remotely?

Remote. Hosted by the provider. You connect with a URL, nothing to install.

How do I add Online Web Directory to Claude Code?

Run: claude mcp add --transport http online-web-directory https://onlinewebdirectory.net/mcp

More search & web scraping MCP servers

View all