Install AI Crawler Access Check in Claude Code
claude mcp add --transport http ai-crawler-access-check https://check.citant.ai/mcp?src=registry{
"mcpServers": {
"ai-crawler-access-check": {
"url": "https://check.citant.ai/mcp?src=registry"
}
}
}Frequently asked questions
What does the AI Crawler Access Check MCP server do?
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
Is the AI Crawler Access Check MCP server free?
The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.
Does AI Crawler Access Check run locally or remotely?
Remote. Hosted by the provider. You connect with a URL, nothing to install.
How do I add AI Crawler Access Check to Claude Code?
Run: claude mcp add --transport http ai-crawler-access-check https://check.citant.ai/mcp?src=registry
More search & web scraping MCP servers
View allAI Crawler Readiness
com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
AI Cortex Storage
dev.aic0rt3x.memory/mcp
Persistent cloud memory for AI agents. Store and search key-value memories across sessions.
AI Deals Sentinel
cc.rockpool.ai-deals/ai-deals-sentinel
Agent-operated. Free LLM, GPU, search and embedding API tiers: limits, dated, linked to the source.
AI Collection
io.github.kerbelp/ai-collection
Discover and compare AI tools: search, browse categories, find alternatives and curated picks.
AI Dev Jobs
com.aidevboard/jobs
MCP for 8,700+ current AI jobs. 13 tools: search, match, salaries, companies, commerce quotes.
AI Architectures
com.ai-architectures/mcp
Search ~500 free house plans and have AI-drafted CAD floor plans (DXF, DWG, PDF) drawn and changed.