Ab Test Setup

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.

376 stars 91 forksTesting & QA Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add mysticaltech/marketingskills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add mysticaltech/marketingskills --skill ab-test-setup
Manual install
git clone --depth 1 https://github.com/mysticaltech/marketingskills.git /tmp/marketingskills
mkdir -p ~/.claude/skills
cp -r /tmp/marketingskills/skills/ab-test-setup ~/.claude/skills/ab-test-setup

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# A/B Test Setup

You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.

## Initial Assessment

**Check for product marketing context first:**
If `.claude/product-marketing-context.md` exists, read it before asking questions. Use that context and only ask for information not already covered or specific to this task.

Before designing a test, understand:

1. **Test Context** - What are you trying to improve? What change are you considering?
2. **Current State** - Baseline conversion rate? Current traffic volume?
3. **Constraints** - Technical complexity? Timeline? Tools available?

---

## Core Principles

### 1. Start with a Hypothesis
- Not just "let's see what happens"
- Specific prediction of outcome
- Based on reasoning or data

### 2. Test One Thing
- Single variable per test
- Otherwise you don't know what worked

### 3. Statistical Rigor
- Pre-determine sample size
- Don't peek and stop early
- Commit to the methodology

### 4. Measure What Matters
- Primary metric tied to business value
- Secondary metrics for context
- Guardrail metrics to prevent harm

---

## Hypothesis Framework

### Structure

```
Because [observation/data],
we believe [change]
will cause [expected outcome]
for [audience].
We'll know this is true when [metrics].
```

### Example

**Weak**: "Changing the button color might increase clicks."
Read the full skill on GitHub

Details

Skill name
ab-test-setup
Path
skills/ab-test-setup/SKILL.md
License
MIT
Repo updated
10 February 2026
Copies
Found in 6 GitHub repos

FAQ

What does the Ab Test Setup skill do?

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.

How do I install the Ab Test Setup skill?

Claude Code plugin: /plugin marketplace add mysticaltech/marketingskills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Ab Test Setup popular?

It lives in mysticaltech/marketingskills, which has 376 GitHub stars and 91 forks.

Related skills

Launch Strategy

376

mysticaltech/marketingskills

When the user wants to plan a product launch, feature announcement, or release strategy. Also use when the user mentions 'launch,' 'Product Hunt,' 'feature release,' 'announcement,' 'go-to-market,' 'beta launch,' 'early access,' 'waitlist,' or 'product update.' This skill covers phased launches, channel strategy, and ongoing launch momentum.

Software Development91

Copy Editing

376

mysticaltech/marketingskills

When the user wants to edit, review, or improve existing marketing copy. Also use when the user mentions 'edit this copy,' 'review my copy,' 'copy feedback,' 'proofread,' 'polish this,' 'make this better,' or 'copy sweep.' This skill provides a systematic approach to editing marketing copy through multiple focused passes.

Marketing, Sales & Business91

Email Sequence

376

mysticaltech/marketingskills

When the user wants to create or optimize an email sequence, drip campaign, automated email flow, or lifecycle email program. Also use when the user mentions "email sequence," "drip campaign," "nurture sequence," "onboarding emails," "welcome sequence," "re-engagement emails," "email automation," or "lifecycle emails." For in-app onboarding, see onboarding-cro.

Productivity & Notes91

Webapp Testing

617

LeastBit/Claude_skills_zh-CN

使用 Playwright 与本地 Web 应用程序交互及进行测试的工具包。支持验证前端功能、调试 UI 行为、捕获浏览器截图以及查看浏览器日志。

Testing & QA96

Test Scenarios

1.2k

borghei/Claude-Skills

Writes QA cases from a feature spec across happy, edge, error, empty, concurrent, accessibility and security paths, then audits coverage. Use when planning QA for a feature, or finding coverage gaps after an incident.

Testing & QAIn 1 list217

Broadband Test

757

chujianyun/skills

宽带测试助手。用于用户要求测网速、测试当前宽带或网络质量时,默认不打开界面,通过本机无头浏览器或已验证接口在中科大、南京大学、测速网依次实测,聚合延迟、抖动、下载和上传速度;不用于仅解释网络术语、购买提速服务或修改网络配置。

Testing & QA102

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.