Taoguba Crawler

This skill should be used when the user asks to "crawl taoguba", "crawl tgb", "scrape taoguba articles", "run the crawler", "crawl bbs", "crawl home page", "generate article HTML", or needs to run the Taoguba (tgb.cn) web crawlers.

16 stars 6 forksData & Analytics

Install

skills CLI (Claude Code, Cursor, Codex and more)

npx skills add lisniuse/taoguba-crawler-skill --skill taoguba-crawler

Manual install

git clone --depth 1 https://github.com/lisniuse/taoguba-crawler-skill.git /tmp/taoguba-crawler-skill
mkdir -p ~/.claude/skills
cp -r /tmp/taoguba-crawler-skill/. ~/.claude/skills/taoguba-crawler

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Taoguba Crawler

This skill runs the Taoguba (tgb.cn) article crawlers located in the project root.

## Prerequisites

- Python 3 with `requests`, `beautifulsoup4`, `python-dotenv` installed
- A `.env` file in the project root containing `COOKIE` and optionally `USER_AGENT`

## Available Crawlers

### 1. BBS Crawler (`crawler_bbs.py`)

Crawl the forum board at `tgb.cn/bbs/1/1` using HTML scraping.

```bash
python crawler_bbs.py
```

- Extracts article list by parsing `a.overhide.mw300` elements
- Gets each article's main post and author replies
- Downloads images and embeds them as base64 in HTML
- Outputs: `output/bbs_YYYY-MM-DD.json` and `output/bbs_YYYY-MM-DD_HHMMSS.html`

### 2. Home Crawler (`crawler_home.py`)

Crawl the homepage recommendations via JSON API (`/newIndex/getZh`).

```bash
python crawler_home.py
```

- Fetches articles from the JSON API (default 2 pages)
- Same content extraction and HTML generation as BBS crawler
- Outputs: `output/home_YYYY-MM-DD.json` and `output/home_YYYY-MM-DD_HHMMSS.html`

## Common Workflow

To run both crawlers:

```bash
python crawler_bbs.py && python crawler_home.py
```

## Key Implementation Details

- **Authentication**: Both scripts read `COOKIE` from `.env` via `python-dotenv`
- **Rate limiting**: 0.5-1s delay between requests to avoid being blocked
- **Image handling**: Images are downloaded and embedded as base64 in the HTML output

Read the full skill on GitHub

Details

Skill name: taoguba-crawler
Repository: lisniuse/taoguba-crawler-skill
License: MIT
Repo updated: 3 April 2026

FAQ

What does the Taoguba Crawler skill do?

How do I install the Taoguba Crawler skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add lisniuse/taoguba-crawler-skill --skill taoguba-crawler. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Taoguba Crawler popular?

It lives in lisniuse/taoguba-crawler-skill, which has 16 GitHub stars and 6 forks.

Related skills

Lemonwrench

bpawnzZ/lemonwrench

Use when looking up car repair procedures, torque specs, diagrams or service-manual steps. Scrapes free OEM manuals by vehicle, resolves the exact trim/engine, and cross-checks parts catalogs and field sources.

Data & Analytics

Majia Guanyuan

maojiebc/majia-guanyuan

观远 BI（Guandata）实战增益层。标准查数、指标批量查询、本地分析、建卡发布、ETL、数据集和表单结构管理、工作流、指标写入路由官方六组件。专攻 ETL 整库治理、SmartETL 全链路重写、引擎报错、自定义图表与 HTML 看板排障、看板口径档案与只读逐格验收、v7 发布兼容、移动端 phoneLayout、门店手机成绩单、SuperApp 的 LLM 中转及历史兼容、AI-native ADS 架构判断。餐饮会员公式见 majia-huiyuan。触发：execute-sql 5001、SQL 直查不可用、ETL 预览汇总、分块取数、历史数据抽取、预览截断、数字出处、看板口径档案、看板答案对账、观远、Guandata、会员、订单、复购率、RFM、ETL 治理、payload_json、自定义图表、HTML 看板、门店手机成绩单、换店滤空、phoneLayout、60004、SuperApp、ILLEGAL_JSON_RES、数据架构。

Data & Analytics

Ziwei Doushu

Linden-TR/ziwei-doushu-skill

When the user asks about 紫微斗数 / Ziwei Doushu / Purple Star Astrology — including 排盘 (chart casting), 命盘解读 (chart reading), 看运势 (fortune reading), 事业/感情/财运/健康等命理咨询, or mentions 十四主星 / 十二宫 / 四化 / 大限 / 流年 / 飞星 / 七星 / 六吉六煞 — use this skill. Also trigger when the user says 算命, 看盘, 算紫微, 帮我看运势, or any request for Chinese metaphysical destiny analysis. Multi-school methodology: Zhongzhou (primary), San He, Fei Xing, Qin Tian Si Hua, He Luo.

Data & Analytics

Ha Bubble Dashboard

johnnyh1975/HA_Bubble_Skill

Home Assistant dashboard design with Bubble Card 3.x, Streamline Card, Sidebar Card and Mushroom — including a merged HA/Bubble/Mushroom CSS theme with colour intelligence, palette recipes, WCAG checks, typography, wall-panel support and full troubleshooting. TRIGGERS: Bubble Card (any card type), Lovelace dashboards, CSS themes, colour palettes, fonts, Streamline templates, Sidebar Card nav, Mushroom chips, room pop-ups, wall panels, masonry→sections migration, native-vs-custom dashboard decisions, troubleshooting. SYMPTOMS: hardcodes hex in YAML · uses pre-v3.2 pop-up format · places pop-up

Data & Analytics

Aiz Infographic

aizzaku/aiz-infographic

An infographic skill for AI agents — works inside Claude Code, Codex, Hermes, OpenClaw, Cursor, and any agent host that loads skills. Create professional infographics as self-contained HTML files with PNG exports. Use when the user asks to create, design, generate, build, or make an infographic, data visualization, visual explainer, chart poster, cheatsheet, or pocket guide. Trigger phrases include "make this visual", "turn this into a graphic", "visualize this data", "infographic for X", "cheatsheet for X", or when the user provides structured data (tokenomics allocations, ecosystem/partner l

Data & Analytics

Notebooklm

JunSuzuki1973/notebooklm-antigravity-skill

Interact with Google NotebookLM via CLI (nlm). Use this when the user wants to manage notebooks, add sources, generate audio podcasts, research topics, query notebooks, or share content.

Data & Analytics

Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.