Crawlbit MCP Server: Install & Setup

Install Crawlbit in Claude Code

Claude Code

claude mcp add crawlbit -- npx -y crawlbit-mcp

mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)

{
  "mcpServers": {
    "crawlbit": {
      "command": "npx",
      "args": [
        "-y",
        "crawlbit-mcp"
      ]
    }
  }
}

Four free tools to check if AI engines can find, read and recognise a site. No API key.

Yes, most likely. Open source and no paid account or API key is mentioned in the listing. Check the provider for current pricing.

Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.

Run: claude mcp add crawlbit -- npx -y crawlbit-mcp

CrustAPI/crustapi-mcp

Live Google + public LinkedIn data: search, maps, profiles, companies, jobs. Pay only for results.

grokkkkkk/cn-theories

Search viral Chinese-internet theories (大水理论, 薄肌理论…) with sources, in Chinese and English.

digital-science/dimensions-analytics-mcp

Search and analyze Dimensions research data: publications, grants, researchers, patents, trials

emretheus/claude-remind-mcp

Search past Claude Code conversations. Local BM25 over JSONL with one-click claude --resume.

joesaby/doctree-mcp

BM25 search + tree navigation over markdown docs for AI agents. No embeddings, no LLM calls.

Severin2k/blumen-komander-mcp

First German florist with a public MCP server. Search bouquets and order flowers via AI in Munich.