Data Pipeline Cicd
Use when the user asks about CI/CD for data pipelines: dbt Slim CI with state:modified, SQLFluff linting, dbt Cloud jobs, environment promotion or schema change management. Produces CI workflows, lint config and promotion gates. Not for general CI platforms (use github-actions) or test design (use data-testing).
Install
npx skills add j4flmao/agent-skills --skill data-pipeline-cicdgit clone --depth 1 https://github.com/j4flmao/agent-skills.git /tmp/agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/agent-skills/skills/data/data-pipeline-cicd ~/.claude/skills/data-pipeline-cicdPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Data Pipeline CI/CD ## Purpose Establish continuous integration and delivery for data pipelines covering SQL code quality, dbt model testing, schema change management, and environment promotion from dev to production. ## Agent Protocol ### Trigger Exact user phrases: "data pipeline CI/CD", "dbt CI/CD", "SQLFluff", "SQL linting", "Atlantis SQL", "data pipeline testing", "environment promotion", "schema change management", "dbt test", "data CI", "database CI/CD", "data quality CI", "SQL review", "data deployment". ### Input Context Before activating, verify: - Data transformation framework (dbt, SQLMesh, Dataform, custom SQL) - Data warehouse (Snowflake, BigQuery, Redshift, Databricks, Postgres) - CI platform (GitHub Actions, GitLab CI, CircleCI, Jenkins) - Environments (dev, staging, prod) and promotion strategy - Testing framework (dbt test, Great Expectations, data-diff, Soda) - Schema migration tool (Alembic, Flyway, dbt migrations) ### Output Artifact CI/CD pipeline configuration with SQL linting rules, dbt test setup, environment promotion workflow, and schema change management as YAML, SQL, and configuration. ### Response Format ```yaml # CI/CD pipeline configuration ``` ```yaml # SQLFluff config ``` ```sql -- dbt test example ``` ```yaml -- dbt Cloud job config ``` No preamble. No postamble. No explanations. No filler/hedging/transitions. Compress output. ### Completion Criteria - [ ] CI pipeline with SQLFluff linting configured
Details
- Skill name
data-pipeline-cicd- Repository
- j4flmao/agent-skills
- Path
skills/data/data-pipeline-cicd/SKILL.md- License
- MIT
- Repo updated
- 17 November 2026
FAQ
What does the Data Pipeline Cicd skill do?
Use when the user asks about CI/CD for data pipelines: dbt Slim CI with state:modified, SQLFluff linting, dbt Cloud jobs, environment promotion or schema change management. Produces CI workflows, lint config and promotion gates. Not for general CI platforms (use github-actions) or test design (use data-testing).
How do I install the Data Pipeline Cicd skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add j4flmao/agent-skills --skill data-pipeline-cicd. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Data Pipeline Cicd popular?
It lives in j4flmao/agent-skills, which has 45 GitHub stars and 6 forks.
Related skills
Agent Observability
45j4flmao/agent-skills
Use when the user asks about agent observability, tracing agent reasoning, debugging an agent loop, OpenTelemetry GenAI spans for LLM calls, LLM cost tracking per agent, agent audit logs or hallucination/eval monitoring in production. Produces instrumentation config, trace schema, dashboards, alerts and cost attribution. Not for generic service tracing without LLMs (use devops-opentelemetry).
AI Agent Architectures
45j4flmao/agent-skills
Use when the user asks to build an AI agent, design an agent that calls tools and keeps memory, write an agent system prompt or pick an agent framework (Claude Agent SDK, OpenAI Agents SDK, LangGraph). Produces an architecture brief covering loop, tools, memory, guardrails and evals, routing depth to child skills. Not for workflow patterns (use ai-agentic-workflows).
AI Agent Core Loop
45j4flmao/agent-skills
Use when the user asks about the agent loop, ReAct vs plan-and-solve, re-planning, Reflexion, an agent stuck in a loop, max iterations or termination conditions. Produces a loop spec or patch with state, success predicate, caps and no-progress detection. Not for overall agent design (use ai-agent-architectures) or tool schemas (use tool-calling-principles).
Data Reverse Etl
45j4flmao/agent-skills
Use when the user asks about reverse ETL with Hightouch or Census, syncing warehouse data to Salesforce or HubSpot, audience export, operational analytics or data activation. Produces sync design with incremental diffing, idempotent upserts and API rate-limit handling. Not for ingestion into the warehouse (use data-etl-pipeline).
Data Etl Pipeline
45j4flmao/agent-skills
Use when the user asks to orchestrate a daily ETL with Airflow and dbt, ETL vs ELT, data ingestion, incremental loads, Airflow 3 DAG design, retries and dead-letter handling. Produces pipeline architecture, DAG and transformation design with validation and observability. Not for real-time CDC (use data-streaming) or wiring dbt into Airflow in depth (use data-airflow-dbt-orchestration).
Data Science Analytics Engineering
45j4flmao/agent-skills
Use when the user asks about analytics engineering with dbt: staging/intermediate/mart models, materializations, incremental models, Jinja macros, the dbt Semantic Layer / MetricFlow, Cube or analytical SQL. Produces dbt project layout, models, tests and metrics. Not for Kimball grain and SCD design (use data-dimensional-modeling) or Airflow wiring (use data-airflow-dbt-orchestration).
Browse the most popular Claude skills, all data & analytics skills, or write your own with the skills generator.