Ab Test Design

Design an A/B test and decide whether available traffic can detect a useful effect. Use when planning a randomized product comparison, checking sample size or test duration, or creating an interactive A/B test card.

298 stars 25 forksTesting & QA Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add superhero-tech/superhero-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add superhero-tech/superhero-skills --skill ab-test-design
Manual install
git clone --depth 1 https://github.com/superhero-tech/superhero-skills.git /tmp/superhero-skills
mkdir -p ~/.claude/skills
cp -r /tmp/superhero-skills/plugins/product-discovery/skills/product-discovery/ab-test-design ~/.claude/skills/ab-test-design

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# A/B Test Design

Help the user decide whether an A/B test is worth running, then produce a compact test card with an interactive calculator. A well-supported decision not to run is a valid outcome.

Respond and produce all artifacts in the user's conversation language.
Keep the conversation light: ask one focused question at a time, explain unfamiliar terms in plain language, and reuse information already supplied. Do not present the whole intake as a questionnaire or require a discovery framework.

## Four conversational gates

### 1. Change and hypothesis

Ask what specifically changes, what behavior or outcome should improve, and why the change should cause it. Help turn vague goals into a concrete comparison; do not invent the user's mechanism.

An initially vague idea, such as a more prominent call to action, is a valid starting point. Help formulate a tentative mechanism without promoting a guess to evidence. Do not reject a visual change merely because it sounds small; assess the decision, effort, traffic and plausible useful effect. If several attributes change, explain that the test evaluates their combined effect.

Draft: "If we [change], then [population] will [observable outcome], because [mechanism]." Name A (current experience) and B (changed experience). This is a first hypothesis; add the measurable target in gate 3.
Read the full skill on GitHub

Details

Skill name
ab-test-design
Path
plugins/product-discovery/skills/product-discovery/ab-test-design/SKILL.md
License
MIT
Repo updated
13 November 2026

FAQ

What does the Ab Test Design skill do?

Design an A/B test and decide whether available traffic can detect a useful effect. Use when planning a randomized product comparison, checking sample size or test duration, or creating an interactive A/B test card.

How do I install the Ab Test Design skill?

Claude Code plugin: /plugin marketplace add superhero-tech/superhero-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Ab Test Design popular?

It lives in superhero-tech/superhero-skills, which has 298 GitHub stars and 25 forks.

Related skills

Affinity Mapping

298

superhero-tech/superhero-skills

Synthesize interview transcripts into evidenced themes and user needs, then render an interactive HTML evidence map. Use when synthesizing interviews, affinity mapping, or preparing opportunities for discovery.

Frontend & Design25

Build Figma Library

298

superhero-tech/superhero-skills

Build or extend a Figma token and component library from product documentation, code, or an existing UI. Prepare it for another agent by checking component properties, composition examples, and handoff, including publishing when reuse spans files. Use for reconstructing design systems and making libraries reusable; screen-only design and documentation of existing components have separate workflows.

Frontend & Design25

Code Event Storming

298

superhero-tech/superhero-skills

Reconstruct an EventStorming board from business behavior evidenced in an existing codebase. Use to map current processes, commands, domain events, read models, and open questions in a self-contained HTML board.

Software Development25

Experiment Design

298

superhero-tech/superhero-skills

Design concrete assumption tests using prototypes, demand tests or commitment tests. Use when turning research or selected ideas into experiments, comparing test methods or revising an experiment plan.

Testing & QA25

Performance Testing Review Multi Agent Review

514

Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI

Use when working with performance testing review multi agent review

Testing & QA146

Fix Flaky Tests

280

intercom/2x-skills

Investigate and fix flaky or intermittently-failing tests in any framework and CI system — detects the framework, CI provider, and app profile, then applies the matching classification and fix patterns. Triggers on a flaky-test issue or CI URL, a test that "passes on retry" or "fails in CI but passes locally", a bot that skipped a test, or a request to reopen or dispute the closure or diagnosis of a flaky-test issue (for that case open the issue first; its title or label confirms scope even when the prompt has no flaky-test keywords).

Testing & QA15

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.