Tech Data Pipeline
Design data pipelines covering ETL vs ELT architectures, data source integration, scheduling, quality checks, and warehouse design. Use this skill when the user needs to move data between systems, build a data warehouse, automate data processing, or improve data reliability — even if they say 'move data from X to Y', 'build an ETL pipeline', 'our data is a mess', or 'set up a data warehouse'.
Install
npx skills add asgard-ai-platform/skills --skill tech-data-pipelinegit clone --depth 1 https://github.com/asgard-ai-platform/skills.git /tmp/skills
mkdir -p ~/.claude/skills
cp -r /tmp/skills/tech-data-pipeline ~/.claude/skills/tech-data-pipelinePersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Data Pipeline Design ## Framework ``` IRON LAW: Data Quality Checks at Every Stage A pipeline that moves bad data fast is worse than no pipeline — it corrupts downstream analytics and decisions. Every pipeline stage (extract, transform, load) must have data quality checks: row counts, null checks, schema validation, freshness checks. "Garbage in, garbage out" is not a warning — it's a guarantee. ``` ### ETL vs ELT | Aspect | ETL (Extract, Transform, Load) | ELT (Extract, Load, Transform) | |--------|-------------------------------|-------------------------------| | Transform where? | Before loading (in pipeline) | After loading (in warehouse) | | Best for | Structured data, compliance-heavy | Cloud warehouses (BigQuery, Snowflake) | | Flexibility | Less (transform logic is fixed) | More (transform in SQL after loading) | | Cost | Compute in pipeline | Compute in warehouse | | Trend | Legacy/on-prem | Modern/cloud-native | ### Pipeline Architecture ``` [Sources] → [Extract] → [Stage] → [Transform] → [Load] → [Serve] ↑ ↓ | [Quality Checks at every stage] [Dashboard] | [Monitoring & Alerting] [API] └──────────────── [Orchestrator (Airflow/Prefect)] ──────┘ ``` ### Data Source Types | Source | Extraction Method | Challenges | |--------|-----------------|-----------|
Details
- Skill name
tech-data-pipeline- Repository
- asgard-ai-platform/skills
- Path
tech-data-pipeline/SKILL.md- License
- MIT
- Repo updated
- 6 June 2026
FAQ
What does the Tech Data Pipeline skill do?
Design data pipelines covering ETL vs ELT architectures, data source integration, scheduling, quality checks, and warehouse design. Use this skill when the user needs to move data between systems, build a data warehouse, automate data processing, or improve data reliability — even if they say 'move data from X to Y', 'build an ETL pipeline', 'our data is a mess', or 'set up a data warehouse'.
How do I install the Tech Data Pipeline skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add asgard-ai-platform/skills --skill tech-data-pipeline. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Tech Data Pipeline popular?
It lives in asgard-ai-platform/skills, which has 248 GitHub stars and 30 forks.
Related skills
Algo Ad Bidding
248asgard-ai-platform/skills
Implement and select ad bidding strategies from manual CPC to automated target-CPA and target-ROAS. Use this skill when the user needs to choose a bidding strategy, set up automated bidding, or optimize bid parameters — even if they say 'what bidding strategy should I use', 'target CPA setup', or 'smart bidding configuration'.
Algo Ad Budget
248asgard-ai-platform/skills
Optimize advertising budget allocation across campaigns using marginal returns analysis. Use this skill when the user needs to distribute budget across multiple campaigns, optimize spend pacing, or maximize overall ROAS under budget constraints — even if they say 'how to split my ad budget', 'campaign budget optimization', or 'diminishing returns on ad spend'.
Algo Ad Ctr
248asgard-ai-platform/skills
Build CTR prediction models for estimating ad click-through rates from features. Use this skill when the user needs to predict click probability, build an ad ranking model, or evaluate ad creative performance — even if they say 'predict click rate', 'ad relevance scoring', or 'which ad will get more clicks'.
Tw Ecom Analytics Benchmarks
248asgard-ai-platform/skills
Taiwan e-commerce benchmark ranges for CVR, ROAS, LTV, AOV, repeat rate, cart-abandon — segmented by vertical (3C, 美妝, 服飾, 母嬰, 生鮮) and channel (DTC, Shopee, momo). Use when a TW merchant asks 'is my CVR / ROAS good?' or when sizing a business case. Source discipline: cite industry report or vendor data; mark undocumented ranges as estimates. STATUS: SKELETON — body pending.
Stat Eda
248asgard-ai-platform/skills
Conduct Exploratory Data Analysis (EDA) using descriptive statistics, visualizations, and data quality checks. Use this skill when the user has a dataset and needs to understand its structure, find patterns, detect anomalies, or prepare data for further analysis — even if they say 'what does this data look like', 'find interesting patterns', 'clean this data', or 'summarize this dataset'.
Tw Ecom Analytics Ga4
248asgard-ai-platform/skills
Implement GA4 for Taiwan e-commerce — Enhanced Ecommerce events (view_item, add_to_cart, begin_checkout, purchase), TW-specific parameter conventions (含稅 revenue, NT$ currency, 統編 as user property), Looker Studio reporting, and Big Query export. Use when instrumenting a TW store with GA4 or auditing existing GA4 setup. Do NOT use for generic analytics (use `ecom-analytics`). STATUS: SKELETON — body pending.
Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.