Scrape
Build a full-site or multi-page Scrapy spider to get structured data from a website, in a new project or added to an existing one. Do not use for analyzing locally saved HTML, fixing or debugging an existing spider, schema-only or existing-spec work, Scrapy Cloud operations, or advisory questions.
Install
/plugin marketplace add zytedata/claude-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add zytedata/claude-skills --skill scrapegit clone --depth 1 https://github.com/zytedata/claude-skills.git /tmp/claude-skills
mkdir -p ~/.claude/skills
cp -r /tmp/claude-skills/skills/scrape ~/.claude/skills/scrapePersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
This file is 307 lines long; read all of them.
You are orchestrating the full web scraping workflow, from a user's prompt to a
working Scrapy spider with web-poet page objects.
## Prerequisites
Requires `uv`. Install if missing.
## Input
This is the user prompt: `$ARGUMENTS`. You need to extract the following information from it:
- **url**: target website URL. May be a homepage or a specific detail page.
- **what**: what to extract (e.g. "product", "job listing", "recipe")
- **other useful details**: user instructions that should affect the plan
(e.g. which fields to extract, whether to use browser rendering etc.)
## Project context
The workflow may run in a repository that already contains Scrapy projects.
Repeated runs should normally add a spider to the existing project rather than
create another domain-named one.
A candidate project is a directory containing `scrapy.cfg`, in the current
directory or an immediate child. `items.py`, `spiders/`, `pages/` and a
standalone `pyproject.toml` are not project markers. Ignore `.venv`, `.scrape`,
`__pycache__` and other generated directories.
The bundled script applies these criteria and prints each candidate as JSON with
a `project_dir`. Run it before the schema handoff, so project and schema context
can inform `/scrape-plan`:
```bash
uv run ${CLAUDE_SKILL_DIR}/scripts/detect_projects.py
```
With no candidate, create a new project using domain-based naming. With several,Details
- Skill name
scrape- Repository
- zytedata/claude-skills
- Path
skills/scrape/SKILL.md- Repo updated
- 26 October 2026
FAQ
What does the Scrape skill do?
Build a full-site or multi-page Scrapy spider to get structured data from a website, in a new project or added to an existing one. Do not use for analyzing locally saved HTML, fixing or debugging an existing spider, schema-only or existing-spec work, Scrapy Cloud operations, or advisory questions.
How do I install the Scrape skill?
Claude Code plugin: /plugin marketplace add zytedata/claude-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Scrape popular?
It lives in zytedata/claude-skills, which has 33 GitHub stars and 5 forks.
Related skills
Scrape Analyze Page
33zytedata/claude-skills
Extract structured data (all available fields with values) from a page saved locally as an HTML file, optionally following a schema. Do not invoke when the user provides a URL. When invoking, pass the user's full request verbatim as args — do not pre-parse file paths and don't rephrase it.
Scrape Plan
33zytedata/claude-skills
Plan a web scrape and author a validated extraction spec — explore a detail page, discover fields, confirm the schema, then validate it with more pages, HTML-variant comparison, extracted values, and an optional browser review, and present the plan for approval.
Scrapy Extra
33zytedata/claude-skills
Read this BEFORE writing, modifying, debugging, or explaining any Scrapy or web-poet code — spiders, page objects, pipelines, settings, selectors — down to a one-line fix, or scaffolding/configuring a Scrapy project, scrapy-poet, scrapy-zyte-api, or browser rendering. These libraries moved on since your training cutoff; invoke this FIRST. NOT for building a scraper for a given site (scrape), a saved HTML file (scrape-analyze-page), or Scrapy Cloud deploy/jobs (zyte).
Employment Law Dashboard
43bstevescherer/heycounsel-community
Build a single-file HTML dashboard for any area of US employment law, modeled after the AI Employment Laws Dashboard. Use this skill any time the user wants to create, build, generate, or update a dashboard, tracker, comparison page, or visual brief covering an employment-law topic across US jurisdictions. Triggers include phrases like "make a dashboard for [topic]", "build a tracker for [employment topic]", "state-by-state comparison page for [topic]", "visualize the legal landscape for [topic]", "create a dashboard like the AI one but for [topic]". The dashboard always includes a masthead, T
Analytics and Er
49dynamics365ninja/d365fo-cli
Model the D365FO analytical and document-generation surfaces — aggregate measurements and the entity store, tiles/cues and KPIs, and Electronic Reporting (ER). Invoke when the user asks about a workspace tile, a KPI, an aggregate measurement, the entity store, Power BI content, or running/binding an ER format.
Ijfw Dashboard
43FerroxLabs/wayland-core
Control the IJFW observation dashboard (start/stop/status). Trigger: 'ijfw dashboard', 'open dashboard', 'show observations', 'dashboard start', 'dashboard stop', 'dashboard status', 'view session activity'.
Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.