Firecrawl Automation

Automate web crawling and data extraction with Firecrawl -- scrape pages, crawl sites, extract structured data, batch scrape URLs, and map website structures through the Claude Skill Firecrawl integration.

5 stars 3 forksProductivity & Notes

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add Engineer1999/A-Curated-List-of-Awesome-Claude-Skills --skill Firecrawl Automation
Manual install
git clone --depth 1 https://github.com/Engineer1999/A-Curated-List-of-Awesome-Claude-Skills.git /tmp/A-Curated-List-of-Awesome-Claude-Skills
mkdir -p ~/.claude/skills
cp -r /tmp/A-Curated-List-of-Awesome-Claude-Skills/app-automations/firecrawl-automation ~/.claude/skills/Firecrawl-Automation

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Firecrawl Automation

Run **Firecrawl** web crawling and extraction directly from Claude Code. Scrape individual pages, crawl entire sites, extract structured data with AI, batch process URL lists, and map website structures without leaving your terminal.

**Toolkit docs:** [claude-skills.ai/toolkits/firecrawl](https://claude-skills.ai/toolkits/firecrawl)

---

## Setup

1. Add the Claude Skill MCP server to your configuration:
   ```
   https://rube.app/mcp
   ```
2. Connect your Firecrawl account when prompted. The agent will provide an authentication link.
3. Be mindful of credit consumption -- scope your crawls tightly and test on small URL sets before scaling.

---

## Core Workflows

### 1. Scrape a Single Page

Fetch content from a URL in multiple formats with optional browser actions for dynamic pages.

**Tool:** `FIRECRAWL_SCRAPE`

Key parameters:
- `url` (required) -- fully qualified URL to scrape
- `formats` -- output formats: `markdown` (default), `html`, `rawHtml`, `links`, `screenshot`, `json`
- `onlyMainContent` (default true) -- extract main content only, excluding nav/footer/ads
- `waitFor` -- milliseconds to wait for JS rendering (default 0)
- `timeout` -- max wait in ms (default 30000)
- `actions` -- browser actions before scraping (click, write, wait, press, scroll)
- `includeTags` / `excludeTags` -- filter by HTML tags
- `jsonOptions` -- for structured extraction with `schema` and/or `prompt`
Read the full skill on GitHub

Details

Skill name
Firecrawl Automation
Path
app-automations/firecrawl-automation/SKILL.md
Repo updated
28 March 2026

FAQ

What does the Firecrawl Automation skill do?

Automate web crawling and data extraction with Firecrawl -- scrape pages, crawl sites, extract structured data, batch scrape URLs, and map website structures through the Claude Skill Firecrawl integration.

How do I install the Firecrawl Automation skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add Engineer1999/A-Curated-List-of-Awesome-Claude-Skills --skill Firecrawl Automation. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Firecrawl Automation popular?

It lives in Engineer1999/A-Curated-List-of-Awesome-Claude-Skills, which has 5 GitHub stars and 3 forks.

Related skills

Browse the most popular Claude skills, all productivity & notes skills, or write your own with the skills generator.