Ab Test Design
Design an A/B test and decide whether available traffic can detect a useful effect. Use when planning a randomized product comparison, checking sample size or test duration, or creating an interactive A/B test card.
Install
/plugin marketplace add superhero-tech/superhero-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add superhero-tech/superhero-skills --skill ab-test-designgit clone --depth 1 https://github.com/superhero-tech/superhero-skills.git /tmp/superhero-skills
mkdir -p ~/.claude/skills
cp -r /tmp/superhero-skills/plugins/product-discovery/skills/product-discovery/ab-test-design ~/.claude/skills/ab-test-designPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# A/B Test Design Help the user decide whether an A/B test is worth running, then produce a compact test card with an interactive calculator. A well-supported decision not to run is a valid outcome. Respond and produce all artifacts in the user's conversation language. Keep the conversation light: ask one focused question at a time, explain unfamiliar terms in plain language, and reuse information already supplied. Do not present the whole intake as a questionnaire or require a discovery framework. ## Four conversational gates ### 1. Change and hypothesis Ask what specifically changes, what behavior or outcome should improve, and why the change should cause it. Help turn vague goals into a concrete comparison; do not invent the user's mechanism. An initially vague idea, such as a more prominent call to action, is a valid starting point. Help formulate a tentative mechanism without promoting a guess to evidence. Do not reject a visual change merely because it sounds small; assess the decision, effort, traffic and plausible useful effect. If several attributes change, explain that the test evaluates their combined effect. Draft: "If we [change], then [population] will [observable outcome], because [mechanism]." Name A (current experience) and B (changed experience). This is a first hypothesis; add the measurable target in gate 3.
Details
- Skill name
ab-test-design- Repository
- superhero-tech/superhero-skills
- Path
plugins/product-discovery/skills/product-discovery/ab-test-design/SKILL.md- License
- MIT
- Repo updated
- 13 November 2026
FAQ
What does the Ab Test Design skill do?
Design an A/B test and decide whether available traffic can detect a useful effect. Use when planning a randomized product comparison, checking sample size or test duration, or creating an interactive A/B test card.
How do I install the Ab Test Design skill?
Claude Code plugin: /plugin marketplace add superhero-tech/superhero-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Ab Test Design popular?
It lives in superhero-tech/superhero-skills, which has 298 GitHub stars and 25 forks.
Related skills
Affinity Mapping
298superhero-tech/superhero-skills
Synthesize interview transcripts into evidenced themes and user needs, then render an interactive HTML evidence map. Use when synthesizing interviews, affinity mapping, or preparing opportunities for discovery.
Build Figma Library
298superhero-tech/superhero-skills
Build or extend a Figma token and component library from product documentation, code, or an existing UI. Prepare it for another agent by checking component properties, composition examples, and handoff, including publishing when reuse spans files. Use for reconstructing design systems and making libraries reusable; screen-only design and documentation of existing components have separate workflows.
Code Event Storming
298superhero-tech/superhero-skills
Reconstruct an EventStorming board from business behavior evidenced in an existing codebase. Use to map current processes, commands, domain events, read models, and open questions in a self-contained HTML board.
Experiment Design
298superhero-tech/superhero-skills
Design concrete assumption tests using prototypes, demand tests or commitment tests. Use when turning research or selected ideas into experiments, comparing test methods or revising an experiment plan.
Performance Testing Review Multi Agent Review
514Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI
Use when working with performance testing review multi agent review
Fix Flaky Tests
280intercom/2x-skills
Investigate and fix flaky or intermittently-failing tests in any framework and CI system — detects the framework, CI provider, and app profile, then applies the matching classification and fix patterns. Triggers on a flaky-test issue or CI URL, a test that "passes on retry" or "fails in CI but passes locally", a bot that skipped a test, or a request to reopen or dispute the closure or diagnosis of a flaky-test issue (for that case open the issue first; its title or label confirms scope even when the prompt has no flaky-test keywords).
Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.