Shopify Admin Agentic Crawler Access

Edit the theme's robots.txt.liquid to explicitly allow AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, Amazonbot) so AI assistants are permitted to read the catalog.

204 stars 23 forksAI, LLMs & Agents Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add 40RTY-ai/shopify-admin-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add 40RTY-ai/shopify-admin-skills --skill shopify-admin-agentic-crawler-access
Manual install
git clone --depth 1 https://github.com/40RTY-ai/shopify-admin-skills.git /tmp/shopify-admin-skills
mkdir -p ~/.claude/skills
cp -r /tmp/shopify-admin-skills/skills/agentic/shopify-admin-agentic-crawler-access ~/.claude/skills/shopify-admin-agentic-crawler-access

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

## Purpose
If your `robots.txt` doesn't address the AI crawlers by name — or worse, disallows them — assistants like ChatGPT, Claude, and Perplexity may never read your store, so you simply don't exist to AI shoppers. Shopify generates `robots.txt` from a theme template (`templates/robots.txt.liquid`); this skill reads that template and appends explicit allow rules for the major AI user-agents (with a clear, idempotent managed block) so foundational models and AI search are permitted to crawl your pages. Fixes the agentiq.report finding `robots-ai-rules`.

## Prerequisites
- Authenticated Shopify CLI session (`shopify auth login --store <domain>`)
- Required API scopes: `read_themes`, `write_themes`

## Parameters
All skills accept these universal parameters:

| Parameter | Type   | Required | Default | Description |
|-----------|--------|----------|---------|-------------|
| store     | string | yes      | —       | Store domain (e.g., mystore.myshopify.com) |
| format    | string | no       | human   | Output format: `human` (default) or `json` |
| dry_run   | bool   | no       | true    | Preview the new robots.txt.liquid without writing (defaults ON — this edits the live theme) |

Skill-specific parameters:

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| theme_id | string | no | — | Theme GID to edit (defaults to the published MAIN theme) |
Read the full skill on GitHub

Details

Skill name
shopify-admin-agentic-crawler-access
Path
skills/agentic/shopify-admin-agentic-crawler-access/SKILL.md
License
MIT
Repo updated
26 October 2026

FAQ

What does the Shopify Admin Agentic Crawler Access skill do?

Edit the theme's robots.txt.liquid to explicitly allow AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, Amazonbot) so AI assistants are permitted to read the catalog.

How do I install the Shopify Admin Agentic Crawler Access skill?

Claude Code plugin: /plugin marketplace add 40RTY-ai/shopify-admin-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Shopify Admin Agentic Crawler Access popular?

It lives in 40RTY-ai/shopify-admin-skills, which has 204 GitHub stars and 23 forks.

Related skills

Shopify Admin Abandoned Cart Recovery

204

40RTY-ai/shopify-admin-skills

Query checkouts abandoned in the last N days, generate unique discount codes per customer, and tag them for re-engagement.

Marketing, Sales & Business23

Shopify Admin Address Correction

204

40RTY-ai/shopify-admin-skills

Update the shipping address on an unfulfilled order before it ships.

Marketing, Sales & Business23

Shopify Admin Agentic Description Enrichment

204

40RTY-ai/shopify-admin-skills

Rewrite thin product descriptions into structured, fact-rich copy (materials, fit, use-cases, the words shoppers actually type) so AI agents have something concrete to quote and match.

AI, LLMs & Agents23

Msp AI Adoption

121

RTFM-IT-Services-LLC/msp-claude-skills

Use this skill when a client or prospect of your managed IT services (MSP) business asks a general AI question: "I want to use AI but don't know where to start", "how can we use AI", "should we be using ChatGPT", "we bought Copilot and nobody uses it", "is Gemini any good", or "can AI help my team". Delivers the AI adoption project. Runs a structured discovery (tools, work, data, comfort), picks three starter use cases, and produces platform-specific workflow cards, prompt templates, and a 30-day adoption plan for Copilot, Gemini, ChatGPT, or Claude. Also for preparing a client AI call, turnin

AI, LLMs & Agents37

Shopify Admin Agentic Image Alt Text

204

40RTY-ai/shopify-admin-skills

Generate and set descriptive alt text on product images so AI agents (which can't 'see' pixels) can understand and recommend what each product looks like.

AI, LLMs & Agents23

Meta Mental Models

248

asgard-ai-platform/skills

Apply a latticework of mental models from multiple disciplines to improve decision quality. Use this skill when the user needs to think more clearly, avoid cognitive blind spots, apply cross-disciplinary reasoning, or evaluate a complex decision from multiple angles — even if they say 'how should I think about this', 'what am I missing', 'give me a different perspective', or 'what frameworks apply here'.

AI, LLMs & Agents30

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.