Crw Best Practices

Reference skill for building production-ready crw integrations. Covers verb selection, call surfaces (CLI/MCP/REST), post-filtering strategies, context-window hygiene, Hybrid RAG patterns, common pitfalls, and crw-specific operational considerations (search backend limits, renderer pool, proxy rotation). Load this when writing application code that embeds crw, designing a multi-step agent workflow, or debugging an integration that isn't behaving as expected.

1,268 stars 102 forksAI, LLMs & Agents Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add fastcrw/crw

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add fastcrw/crw --skill crw-best-practices
Manual install
git clone --depth 1 https://github.com/fastcrw/crw.git /tmp/crw
mkdir -p ~/.claude/skills
cp -r /tmp/crw/skills/crw-best-practices ~/.claude/skills/crw-best-practices

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# crw Best Practices

Reference documentation for developers and AI agents using crw (fastCRW) in
production. Covers decision-making, integration patterns, and crw-specific
operational details.

## 1. Choosing the right verb

Stop at the cheapest rung that answers the need. Don't reach for a heavier verb
than the task requires.

| Need | Verb | Notes |
|------|------|-------|
| You have a question/topic, not a URL | **search** | Own search backend, no API key required. Returns titles + URLs + snippets. Add `scrapeOptions` to get markdown inline. |
| You have one (or a few) known URLs | **scrape** | Returns markdown, HTML, links, or structured JSON. JS auto-detected. |
| You need to discover which URLs exist on a site | **map** | Fast URL discovery via sitemap + BFS. No content fetched. Use before committing to a crawl. |
| You need content from many pages under a site | **crawl** | Async BFS job. Poll with `crw_check_crawl_status`. Always `map` first to estimate size. |
| The source is a local file (PDF) | **parse** | `crw_parse_file` (MCP) or `crw scrape path/to/file.pdf` (CLI). No network call. |
| You need a typed JSON object from a page | **extract** | `--extract '<schema>'` (CLI) or `extract: {schema: {...}}` (MCP/REST). Runs an LLM; costs tokens. |
| You want to detect what changed on a page | **watch / diff** | `POST /v1/change-tracking/diff`. Stateless diff primitive; no stored state needed. |

**Common chains:**
- `search` → pick URLs → `scrape` the best ones
Read the full skill on GitHub

Details

Skill name
crw-best-practices
Repository
fastcrw/crw
Path
skills/crw-best-practices/SKILL.md
License
AGPL-3.0
Repo updated
18 November 2026

FAQ

What does the Crw Best Practices skill do?

Reference skill for building production-ready crw integrations. Covers verb selection, call surfaces (CLI/MCP/REST), post-filtering strategies, context-window hygiene, Hybrid RAG patterns, common pitfalls, and crw-specific operational considerations (search backend limits, renderer pool, proxy rotation). Load this when writing application code that embeds crw, designing a multi-step agent workflow, or debugging an integration that isn't behaving as expected.

How do I install the Crw Best Practices skill?

Claude Code plugin: /plugin marketplace add fastcrw/crw. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Crw Best Practices popular?

It lives in fastcrw/crw, which has 1,268 GitHub stars and 102 forks, and is included in 1 curated skill list.

Related skills

Crw

1.3k

fastcrw/crw

Scrape, crawl, map, and search the web using fastCRW's native /v1 API. Use when the user needs web page content, site-wide extraction, URL discovery, or web search results. Single binary, 14 MB RAM; /v2 exists separately for Firecrawl migration.

Writing & ContentIn 1 list102

Crw

1.3k

fastcrw/crw

Scrape, crawl, map, search, parse, and extract web data with fastCRW — the open-source, self-hostable Firecrawl alternative (single Rust binary, ~14 MB RAM, Firecrawl-compatible /v1 + /v2 API). Use whenever the user needs page content, site-wide extraction, URL discovery, web search, PDF parsing, structured JSON from pages, or change tracking. Also use when the user mentions Firecrawl, Tavily, Crawl4AI, or "scrape/crawl/map/fetch/get the page/read this site/search the web" — crw is a drop-in for the Firecrawl SDKs.

Data & AnalyticsIn 1 list102

Crw Crawl

1.3k

fastcrw/crw

Crawl an entire website or section and extract content from every page. Use when you need content from many pages under a common URL prefix: "crawl the whole site", "get all docs pages", "scrape every blog post", "download the full docs for RAG", "extract all pages under /api". Async BFS — starts a job and polls for results. Step 4 of the crw workflow ladder.

Data & AnalyticsIn 1 list102

Context Manager

2k

rmyndharis/antigravity-skills

Elite AI context engineering specialist mastering dynamic context management, vector databases, knowledge graphs, and intelligent memory systems. Orchestrates context across multi-agent workflows, enterprise AI systems, and long-running projects with current best practices. Use for complex AI orchestration.

AI, LLMs & Agents295

Binance Sports AI Analyzer

1.2k

binance/binance-skills-hub

Use when users ask for World Cup or 世界杯 AI match predictions, WC assistant probabilities, World Cup news insights, master analysis, recomputing football match win rates with custom correction signals, or trading a related prediction market after reviewing the AI analysis.

AI, LLMs & AgentsIn 1 list277

Langchain Architecture

2k

rmyndharis/antigravity-skills

Design LLM applications using the LangChain framework with agents, memory, and tool integration patterns. Use when building LangChain applications, implementing AI agents, or creating complex LLM workflows.

AI, LLMs & Agents295

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.