Ab Test Setup

Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

514 stars 146 forksTesting & QA

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI --skill ab-test-setup
Manual install
git clone --depth 1 https://github.com/Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI.git /tmp/Agent-Skills-4-Vibe-Coding-CLI
mkdir -p ~/.claude/skills
cp -r /tmp/Agent-Skills-4-Vibe-Coding-CLI/.agent/skills/ab-test-setup ~/.claude/skills/ab-test-setup

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# A/B Test Setup

## 1️⃣ Purpose & Scope

Ensure every A/B test is **valid, rigorous, and safe** before a single line of code is written.

- Prevents "peeking"
- Enforces statistical power
- Blocks invalid hypotheses

---

## 2️⃣ Pre-Requisites

You must have:

- A clear user problem
- Access to an analytics source
- Roughly estimated traffic volume

## 🧠 Knowledge Modules (Fractal Skills)

### 1. [Hypothesis Quality Checklist](./sub-skills/hypothesis-quality-checklist.md)
### 2. [3️⃣ Hypothesis Lock (Hard Gate)](./sub-skills/3-hypothesis-lock-hard-gate.md)
### 3. [4️⃣ Assumptions & Validity Check (Mandatory)](./sub-skills/4-assumptions-validity-check-mandatory.md)
### 4. [5️⃣ Test Type Selection](./sub-skills/5-test-type-selection.md)
### 5. [6️⃣ Metrics Definition](./sub-skills/6-metrics-definition.md)
### 6. [7️⃣ Sample Size & Duration](./sub-skills/7-sample-size-duration.md)
### 7. [8️⃣ Execution Readiness Gate (Hard Stop)](./sub-skills/8-execution-readiness-gate-hard-stop.md)
### 8. [During the Test](./sub-skills/during-the-test.md)
### 9. [Analysis Discipline](./sub-skills/analysis-discipline.md)
### 10. [Interpretation Outcomes](./sub-skills/interpretation-outcomes.md)
### 11. [Test Record (Mandatory)](./sub-skills/test-record-mandatory.md)
Read the full skill on GitHub

Details

Skill name
ab-test-setup
Path
.agent/skills/ab-test-setup/SKILL.md
Repo updated
11 June 2026
Copies
Found in 2 GitHub repos

FAQ

What does the Ab Test Setup skill do?

Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

How do I install the Ab Test Setup skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI --skill ab-test-setup. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Ab Test Setup popular?

It lives in Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI, which has 514 GitHub stars and 146 forks.

Related skills

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.