Crawl4Agent MCP Server: Install & Setup

Install Crawl4Agent in Claude Code

Claude Code

claude mcp add --transport http crawl4agent https://crawl4agent.saastemly.com/mcp

mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)

{
  "mcpServers": {
    "crawl4agent": {
      "url": "https://crawl4agent.saastemly.com/mcp"
    }
  }
}

Frequently asked questions

What does the Crawl4Agent MCP server do?

crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...

Is the Crawl4Agent MCP server free?

The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.

Does Crawl4Agent run locally or remotely?

Remote. Hosted by the provider. You connect with a URL, nothing to install.

How do I add Crawl4Agent to Claude Code?

Run: claude mcp add --transport http crawl4agent https://crawl4agent.saastemly.com/mcp

More search & web scraping MCP servers

View all

CrawlCheck

emmanuelorta/crawlcheck-core

Verification layer for the agentic web: a signed answer about any site before an agent acts.

RemoteAccount needed

Crawl Census

taylorsmithgg/crawl-census-client

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

RemoteAccount needed

Crawlinx

im-ff/crawlinx-mcp

Free technical-SEO audit MCP: crawl a site, run checks, return an LLM-ready shareable report.

RemoteFree

Cralo

amrnth/opentooler

Pay-per-use tool marketplace for AI agents. Search, price-check, and call APIs via MCP.

RemotePaid service

CrawlKit Scrapers

CrawlKit560/crawlkit-scrapers

Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP

RemoteAccount needed

Craigslist Scraper & Tracker (cars, housing)

io.github.akhilrajesh213/craigslist-scraper

Craigslist listings for AI agents: search by keyword, city, state and category; cars, rentals.

RemoteAccount needed