Scraper Builder
Guide AI agents to generate complete PageObject pattern web scraper projects using Playwright and TypeScript with Docker deployment. Supports agent-browser site analysis for automated selector discovery. Keywords: scraper, playwright, pageobject, web scraping, docker, typescript, data extraction, automation.
Install
npx skills add jwynia/agent-skills --skill scraper-buildergit clone --depth 1 https://github.com/jwynia/agent-skills.git /tmp/agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/agent-skills/skills/tech/development/tooling/scraper-builder ~/.claude/skills/scraper-builderPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Scraper Builder Generate complete, runnable web scraper projects using the PageObject pattern with Playwright and TypeScript. This skill produces site-specific scrapers with typed data extraction, Docker deployment, and optional agent-browser integration for automated site analysis. ## When to Use This Skill Use this skill when: - Building a site-specific web scraper for data extraction - Generating PageObject classes for a target website - Scaffolding a complete scraper project with Docker support - Using agent-browser to analyze a site and auto-generate selectors - Creating reusable scraping components (pagination, data tables) Do NOT use this skill when: - Building API clients (use HTTP client libraries directly) - Writing QA/E2E test suites (use Playwright test runner with test-focused patterns) - Mass crawling or spidering entire domains (use Crawlee or Scrapy) - Scraping sites that require authentication bypass or CAPTCHA solving ## Core Principles ### 1. PageObject Encapsulation Each page on the target site maps to one PageObject class. Locators are defined in the constructor, and scraping logic lives in methods. Page objects never contain assertions or business logic — they extract and return data. ### 2. Selector Resilience
Details
- Skill name
scraper-builder- Repository
- jwynia/agent-skills
- Path
skills/tech/development/tooling/scraper-builder/SKILL.md- Repo updated
- 24 February 2026
FAQ
What does the Scraper Builder skill do?
Guide AI agents to generate complete PageObject pattern web scraper projects using Playwright and TypeScript with Docker deployment. Supports agent-browser site analysis for automated selector discovery. Keywords: scraper, playwright, pageobject, web scraping, docker, typescript, data extraction, automation.
How do I install the Scraper Builder skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add jwynia/agent-skills --skill scraper-builder. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Scraper Builder popular?
It lives in jwynia/agent-skills, which has 191 GitHub stars and 24 forks.
Related skills
Abstract Strategy
191jwynia/agent-skills
Design abstract strategy games with perfect information, no randomness, and strategic depth. Use when designing a board game, exploring abstract strategy games, brainstorming game mechanics, or evaluating game balance. Keywords: board game, game design, strategy, mechanics, balance.
Adaptation Synthesis
191jwynia/agent-skills
Synthesize new works from extracted functional DNA documents. Use when adapting a source work to a new context, when combining multiple source extractions, or when generating variations that preserve function while changing form.
Agent Bootstrap
191jwynia/agent-skills
Bootstrap agentic development environment from agent.toml manifest
Sentiment Analyzer
150guia-matthieu/clawfu-skills
Analyze sentiment in text using ML models. Use when: analyzing customer reviews; processing NPS feedback; monitoring brand mentions; evaluating campaign responses; categorizing support tickets
Funnel Analyzer
150guia-matthieu/clawfu-skills
Analyze conversion funnels and identify drop-offs. Use when: analyzing checkout funnel; tracking signup flow; identifying conversion blockers; optimizing user journey; visualizing funnel performance
Social Analytics
150guia-matthieu/clawfu-skills
Analyze social media profiles and engagement. Use when: auditing competitor social presence; calculating engagement rates; identifying top-performing content; tracking profile growth; benchmarking social metrics
Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.