Web Fetcher

Fetch any URL as clean markdown. Use instead of WebFetch for JS-rendered pages, login-required platforms (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.), and complex pages. Routes known platforms through OpenCLI (browser login state), others through Jina Reader / defuddle.md / markdown.new. Invoke when the user provides a URL to read, extract, summarize, or convert to markdown.

44 stars 1 forksOther Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add jiahao-shao1/sjh-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add jiahao-shao1/sjh-skills --skill web-fetcher
Manual install
git clone --depth 1 https://github.com/jiahao-shao1/sjh-skills.git /tmp/sjh-skills
mkdir -p ~/.claude/skills
cp -r /tmp/sjh-skills/skills/web-fetcher ~/.claude/skills/web-fetcher

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Web Fetcher

Fetch any URL as clean markdown. Two paths: known platforms go through OpenCLI (uses browser login state), everything else falls back through a chain of free markdown services.

## Strategy Overview

1. **Known platforms** (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.) → OpenCLI first. It uses the user's browser login state, is deterministic, and costs zero LLM tokens.
2. **Generic URLs** (blogs, docs, articles) → Jina Reader > defuddle.md > markdown.new > WebFetch.

These are soft priorities — skip obviously wrong strategies (e.g., don't try OpenCLI for a random blog post, don't try Jina for a login-walled zhihu page).

## Known Platform → OpenCLI Commands

| URL Pattern | Command | Notes |
|-------------|---------|-------|
| `x.com/.../status/<id>` | `opencli twitter thread <id>` | Tweet threads. If the result is just a t.co link (very short text), the tweet likely links to an X Article — retry with `opencli twitter article <same-id>` |
| `x.com/.../article/<id>` or `x.com/i/article/<id>` | `opencli twitter article <id>` | X Article long-form |
| `zhihu.com/question/<id>` | `opencli zhihu question <id>` | |
| `zhuanlan.zhihu.com/p/<id>` | `opencli zhihu download <full-url>` | |
| `reddit.com/r/.../comments/...` | `opencli reddit read <full-url>` | |
| `weibo.com/...` | `opencli weibo search <query>` | |
| `xiaohongshu.com/...` | `opencli xiaohongshu download <id>` | |
| `bilibili.com/video/BV...` | `opencli bilibili download <bvid>` | |
Read the full skill on GitHub

Details

Skill name
web-fetcher
Path
skills/web-fetcher/SKILL.md
License
MIT
Repo updated
18 November 2026

FAQ

What does the Web Fetcher skill do?

Fetch any URL as clean markdown. Use instead of WebFetch for JS-rendered pages, login-required platforms (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.), and complex pages. Routes known platforms through OpenCLI (browser login state), others through Jina Reader / defuddle.md / markdown.new. Invoke when the user provides a URL to read, extract, summarize, or convert to markdown.

How do I install the Web Fetcher skill?

Claude Code plugin: /plugin marketplace add jiahao-shao1/sjh-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Web Fetcher popular?

It lives in jiahao-shao1/sjh-skills, which has 44 GitHub stars and 1 forks.

Related skills

Bibtex Fetch

44

jiahao-shao1/sjh-skills

Fetch BibTeX entries from arXiv / Semantic Scholar. Triggers: 'fetch bibtex', 'cite this paper', 'arXiv bibtex', '拉 bibtex', '获取引用', '引用这篇论文'. Not for citation format conversion (APA/MLA) or literature review.

Research & Science

Context Audit

44

jiahao-shao1/sjh-skills

Audit project context management (CLAUDE.md, rules, knowledge) for progressive disclosure compliance. Checks that all knowledge files are reachable from rules, detects stale references, orphaned files, and CLAUDE.md index leakage. Triggers: 'audit context', 'check context', 'context hygiene', 'context audit', '检查 context', '审计上下文', 'knowledge 覆盖检查'. NOT for: code review, rule content correctness, or knowledge content quality.

Writing & Content

Daily Summary

44

jiahao-shao1/sjh-skills

Produce daily/yesterday work summary (日报) by aggregating Claude Code sessions, Git commits, and Notion task data — git log alone cannot do this. Args: today (default), yesterday, 24h, YYYY-MM-DD. Triggers: 'daily summary', 'what did I do today', 'yesterday summary', '日报', '今天干了什么', '工作总结', '某天做了什么'. Not for weekly reports or summarizing files.

Git & Code Review

Wiki Maintenance

43

rohitg00/agentbrain

Use when source-backed project knowledge needs to be created, refreshed, or corrected.

Other

Question Ladder

43

rohitg00/agentbrain

Use when uncertainty remains and the minimum useful sequence of questions should be asked.

Other

Clarion Regime Check

46

zocomputer/skills

Reads the SPY/TLT/RSP color regime and the equity hurdle rate. Use when the user asks about the market regime, risk-on / risk-off, market color, SPY/TLT regime, breadth, or what hurdle rate to use for new positions. Pulls daily bars via yfinance (cached locally). Optionally accepts a 1Y T-bill yield to compute the equity hurdle rate. Requires clarion-setup to have been run.

Other56

Browse the most popular Claude skills, all other skills, or write your own with the skills generator.