Web Fetcher
Fetch any URL as clean markdown. Use instead of WebFetch for JS-rendered pages, login-required platforms (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.), and complex pages. Routes known platforms through OpenCLI (browser login state), others through Jina Reader / defuddle.md / markdown.new. Invoke when the user provides a URL to read, extract, summarize, or convert to markdown.
Install
/plugin marketplace add jiahao-shao1/sjh-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add jiahao-shao1/sjh-skills --skill web-fetchergit clone --depth 1 https://github.com/jiahao-shao1/sjh-skills.git /tmp/sjh-skills
mkdir -p ~/.claude/skills
cp -r /tmp/sjh-skills/skills/web-fetcher ~/.claude/skills/web-fetcherPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Web Fetcher Fetch any URL as clean markdown. Two paths: known platforms go through OpenCLI (uses browser login state), everything else falls back through a chain of free markdown services. ## Strategy Overview 1. **Known platforms** (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.) → OpenCLI first. It uses the user's browser login state, is deterministic, and costs zero LLM tokens. 2. **Generic URLs** (blogs, docs, articles) → Jina Reader > defuddle.md > markdown.new > WebFetch. These are soft priorities — skip obviously wrong strategies (e.g., don't try OpenCLI for a random blog post, don't try Jina for a login-walled zhihu page). ## Known Platform → OpenCLI Commands | URL Pattern | Command | Notes | |-------------|---------|-------| | `x.com/.../status/<id>` | `opencli twitter thread <id>` | Tweet threads. If the result is just a t.co link (very short text), the tweet likely links to an X Article — retry with `opencli twitter article <same-id>` | | `x.com/.../article/<id>` or `x.com/i/article/<id>` | `opencli twitter article <id>` | X Article long-form | | `zhihu.com/question/<id>` | `opencli zhihu question <id>` | | | `zhuanlan.zhihu.com/p/<id>` | `opencli zhihu download <full-url>` | | | `reddit.com/r/.../comments/...` | `opencli reddit read <full-url>` | | | `weibo.com/...` | `opencli weibo search <query>` | | | `xiaohongshu.com/...` | `opencli xiaohongshu download <id>` | | | `bilibili.com/video/BV...` | `opencli bilibili download <bvid>` | |
Details
- Skill name
web-fetcher- Repository
- jiahao-shao1/sjh-skills
- Path
skills/web-fetcher/SKILL.md- License
- MIT
- Repo updated
- 18 November 2026
FAQ
What does the Web Fetcher skill do?
Fetch any URL as clean markdown. Use instead of WebFetch for JS-rendered pages, login-required platforms (Twitter/X, zhihu, reddit, weibo, xiaohongshu, bilibili, etc.), and complex pages. Routes known platforms through OpenCLI (browser login state), others through Jina Reader / defuddle.md / markdown.new. Invoke when the user provides a URL to read, extract, summarize, or convert to markdown.
How do I install the Web Fetcher skill?
Claude Code plugin: /plugin marketplace add jiahao-shao1/sjh-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Web Fetcher popular?
It lives in jiahao-shao1/sjh-skills, which has 44 GitHub stars and 1 forks.
Related skills
Bibtex Fetch
44jiahao-shao1/sjh-skills
Fetch BibTeX entries from arXiv / Semantic Scholar. Triggers: 'fetch bibtex', 'cite this paper', 'arXiv bibtex', '拉 bibtex', '获取引用', '引用这篇论文'. Not for citation format conversion (APA/MLA) or literature review.
Context Audit
44jiahao-shao1/sjh-skills
Audit project context management (CLAUDE.md, rules, knowledge) for progressive disclosure compliance. Checks that all knowledge files are reachable from rules, detects stale references, orphaned files, and CLAUDE.md index leakage. Triggers: 'audit context', 'check context', 'context hygiene', 'context audit', '检查 context', '审计上下文', 'knowledge 覆盖检查'. NOT for: code review, rule content correctness, or knowledge content quality.
Daily Summary
44jiahao-shao1/sjh-skills
Produce daily/yesterday work summary (日报) by aggregating Claude Code sessions, Git commits, and Notion task data — git log alone cannot do this. Args: today (default), yesterday, 24h, YYYY-MM-DD. Triggers: 'daily summary', 'what did I do today', 'yesterday summary', '日报', '今天干了什么', '工作总结', '某天做了什么'. Not for weekly reports or summarizing files.
Wiki Maintenance
43rohitg00/agentbrain
Use when source-backed project knowledge needs to be created, refreshed, or corrected.
Question Ladder
43rohitg00/agentbrain
Use when uncertainty remains and the minimum useful sequence of questions should be asked.
Clarion Regime Check
46zocomputer/skills
Reads the SPY/TLT/RSP color regime and the equity hurdle rate. Use when the user asks about the market regime, risk-on / risk-off, market color, SPY/TLT regime, breadth, or what hurdle rate to use for new positions. Pulls daily bars via yfinance (cached locally). Optionally accepts a 1Y T-bill yield to compute the equity hurdle rate. Requires clarion-setup to have been run.
Browse the most popular Claude skills, all other skills, or write your own with the skills generator.