Install AI Crawler Readiness in Claude Code
claude mcp add --transport http ai-crawler-readiness https://shop.lumnika.com/ai-readiness/mcp{
"mcpServers": {
"ai-crawler-readiness": {
"url": "https://shop.lumnika.com/ai-readiness/mcp"
}
}
}Frequently asked questions
What does the AI Crawler Readiness MCP server do?
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Is the AI Crawler Readiness MCP server free?
The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.
Does AI Crawler Readiness run locally or remotely?
Remote. Hosted by the provider. You connect with a URL, nothing to install.
How do I add AI Crawler Readiness to Claude Code?
Run: claude mcp add --transport http ai-crawler-readiness https://shop.lumnika.com/ai-readiness/mcp
More search & web scraping MCP servers
View allAI Deals Sentinel
cc.rockpool.ai-deals/ai-deals-sentinel
Agent-operated. Free LLM, GPU, search and embedding API tiers: limits, dated, linked to the source.
AI Crawler Access Check
io.github.hamzawamiqhq/ai-crawler-check
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
AI Dev Jobs
com.aidevboard/jobs
MCP for 8,700+ current AI jobs. 13 tools: search, match, salaries, companies, commerce quotes.
AI Cortex Storage
dev.aic0rt3x.memory/mcp
Persistent cloud memory for AI agents. Store and search key-value memories across sessions.
AI Reasoning Commons
chenyuan35/aineedhelpfromotherai
Search, reuse, verify AI reasoning. Task marketplace with leaderboard. Zero-barrier, no auth.
AI Collection
io.github.kerbelp/ai-collection
Discover and compare AI tools: search, browse categories, find alternatives and curated picks.