Crw Scrape

Scrape a single known URL into clean markdown / HTML / links / structured JSON with fastCRW. Use when you already have the URL and want the page content — "scrape", "grab", "fetch", "pull", "read this page", "get the content of". Handles JavaScript-rendered SPAs automatically. Step 2 of the crw workflow ladder.

1,268 stars 102 forksData & Analytics Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add fastcrw/crw

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add fastcrw/crw --skill crw-scrape
Manual install
git clone --depth 1 https://github.com/fastcrw/crw.git /tmp/crw
mkdir -p ~/.claude/skills
cp -r /tmp/crw/skills/crw-scrape ~/.claude/skills/crw-scrape

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# crw-scrape — single-page extraction

## When to use

- You have one (or a handful of) **known URLs** and want their content.
- Step 2 in the [crw ladder](../crw/SKILL.md): if you don't have a URL yet, go
  to [crw-search](../crw-search/SKILL.md) (step 1) first. For many pages under a
  site, use [crw-crawl](../crw-crawl/SKILL.md) (step 4). For a local PDF, use
  [crw-parse](../crw-parse/SKILL.md) (step 5).
- JS-heavy page? You usually don't need anything special — crw auto-detects and
  renders. This is a crw advantage: no separate "interact"/browser step.

## Quick start

**CLI** (binary on PATH):
```bash
crw scrape "https://example.com"                       # → markdown to stdout
crw scrape "https://example.com" --format json -o page.json
crw scrape "https://example.com" --js --css "article.main"
crw scrape "https://example.com" --format links -o .crw/links.txt
```

**MCP** (inside an agent harness):
```
crw_scrape(url="https://example.com", formats=["markdown"], onlyMainContent=true)
```

**REST** (drop-in for Firecrawl SDKs — just swap the base URL):
```bash
curl -X POST "$CRW_API_URL/v1/scrape" -H "Authorization: Bearer $CRW_API_KEY" \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com","formats":["markdown"],"onlyMainContent":true}'
```

## Options

| Need | CLI flag | MCP / REST field |
|------|----------|------------------|
| Output format | `--format markdown\|html\|rawhtml\|text\|links\|json` | `formats: [...]` |
Read the full skill on GitHub

Details

Skill name
crw-scrape
Repository
fastcrw/crw
Path
skills/crw-scrape/SKILL.md
License
AGPL-3.0
Repo updated
18 November 2026

FAQ

What does the Crw Scrape skill do?

Scrape a single known URL into clean markdown / HTML / links / structured JSON with fastCRW. Use when you already have the URL and want the page content — "scrape", "grab", "fetch", "pull", "read this page", "get the content of". Handles JavaScript-rendered SPAs automatically. Step 2 of the crw workflow ladder.

How do I install the Crw Scrape skill?

Claude Code plugin: /plugin marketplace add fastcrw/crw. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Crw Scrape popular?

It lives in fastcrw/crw, which has 1,268 GitHub stars and 102 forks, and is included in 1 curated skill list.

Related skills

Crw

1.3k

fastcrw/crw

Scrape, crawl, map, and search the web using fastCRW's native /v1 API. Use when the user needs web page content, site-wide extraction, URL discovery, or web search results. Single binary, 14 MB RAM; /v2 exists separately for Firecrawl migration.

Writing & ContentIn 1 list102

Crw

1.3k

fastcrw/crw

Scrape, crawl, map, search, parse, and extract web data with fastCRW — the open-source, self-hostable Firecrawl alternative (single Rust binary, ~14 MB RAM, Firecrawl-compatible /v1 + /v2 API). Use whenever the user needs page content, site-wide extraction, URL discovery, web search, PDF parsing, structured JSON from pages, or change tracking. Also use when the user mentions Firecrawl, Tavily, Crawl4AI, or "scrape/crawl/map/fetch/get the page/read this site/search the web" — crw is a drop-in for the Firecrawl SDKs.

Data & AnalyticsIn 1 list102

Crw Best Practices

1.3k

fastcrw/crw

Reference skill for building production-ready crw integrations. Covers verb selection, call surfaces (CLI/MCP/REST), post-filtering strategies, context-window hygiene, Hybrid RAG patterns, common pitfalls, and crw-specific operational considerations (search backend limits, renderer pool, proxy rotation). Load this when writing application code that embeds crw, designing a multi-step agent workflow, or debugging an integration that isn't behaving as expected.

AI, LLMs & AgentsIn 1 list102

Crw Watch

1.3k

fastcrw/crw

Detect what changed between two page snapshots with fastCRW — stateless diff as a REST primitive. Use when you need to track content changes, monitor a page for updates, or build a cron-based alert system: "has this page changed?", "alert me when pricing changes", "diff this week's scrape against last week's". Step 7 of the crw workflow ladder.

Data & AnalyticsIn 1 list102

Crw Map

1.3k

fastcrw/crw

Discover all URLs on a website without fetching content — fast, low-cost URL inventory via sitemap.xml + link extraction BFS. Use when you need to know which pages exist before deciding what to scrape or crawl: "list all pages", "find URLs on this site", "discover links", "what pages does this site have", "map the site". Step 3 of the crw workflow ladder.

Data & AnalyticsIn 1 list102

Data Engineer

2k

rmyndharis/antigravity-skills

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms. Use for data pipeline design, analytics infrastructure, or modern data stack implementation.

Data & Analytics295

Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.