Experiment Designer
Design statistically rigorous A/B tests and interpret experiment results. Use when asked to design an experiment, run an A/B test, calculate sample size, interpret test results, or assess whether an experiment was successful. Produces a complete experiment design with hypothesis, sample size, run time, success criteria, and risk flags — or a results interpretation with ship/iterate/kill recommendation.
Install
/plugin marketplace add mohitagw15856/pm-claude-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add mohitagw15856/pm-claude-skills --skill experiment-designergit clone --depth 1 https://github.com/mohitagw15856/pm-claude-skills.git /tmp/pm-claude-skills
mkdir -p ~/.claude/skills
cp -r /tmp/pm-claude-skills/plugins/pm-advanced/skills/experiment-designer ~/.claude/skills/experiment-designerPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Experiment Designer Skill Produce rigorous experiment designs from product hypotheses, and interpret results with statistical and practical significance — so you can defend every decision to a sceptical engineering lead or data scientist. ## Required Inputs Work from what is given. If any of these is missing, still produce the complete output: fill each gap with a reasonable assumption marked *(assumed, confirm)* and list those assumptions at the end. Ask a question first only when the core subject itself is missing (there is nothing to write about). **For experiment design:** - Hypothesis (what change, what metric, what expected movement) - Current baseline metric value - Minimum detectable effect (MDE) — the smallest lift worth caring about - Available daily sample size **For results interpretation:** - Control and variant results (raw numbers or percentages) - P-value or confidence interval - Run duration (days) - Any anomalies observed during the test ## Two-Phase Process ### Phase 1: Experiment Design 1. Restate hypothesis as: "If we [change], we expect [metric] to [move by X%] because [reason]" 2. Define control and variant clearly 3. Select primary metric (one only) and secondary guardrail metrics (2-3 max) 4. Calculate required sample size from MDE and baseline 5. Estimate run time in days 6. Set pre-defined success criteria before the test runs — no moving goalposts
Details
- Skill name
experiment-designer- Repository
- mohitagw15856/pm-claude-skills
- Path
plugins/pm-advanced/skills/experiment-designer/SKILL.md- License
- MIT
- Repo updated
- 18 November 2026
- Listed in
- BehiSecc/awesome-claude-skills
FAQ
What does the Experiment Designer skill do?
Design statistically rigorous A/B tests and interpret experiment results. Use when asked to design an experiment, run an A/B test, calculate sample size, interpret test results, or assess whether an experiment was successful. Produces a complete experiment design with hypothesis, sample size, run time, success criteria, and risk flags — or a results interpretation with ship/iterate/kill recommendation.
How do I install the Experiment Designer skill?
Claude Code plugin: /plugin marketplace add mohitagw15856/pm-claude-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Experiment Designer popular?
It lives in mohitagw15856/pm-claude-skills, which has 1,573 GitHub stars and 281 forks, and is included in 1 curated skill list.
Related skills
Ab Test Planner
1.6kmohitagw15856/pm-claude-skills
Diseña pruebas A/B estadísticamente rigurosas para características de producto, cambios de UI, flujos de onboarding y experimentos de precios. Úsalo cuando te pidan configurar un experimento, diseñar una prueba A/B, calcular tamaño de muestra o interpretar resultados de pruebas. Produce un plan de prueba completo con hipótesis, definición de variantes, tamaño de muestra, estimación de duración, métricas de seguridad y una guía de interpretación de resultados.
Ab Test Planner
1.6kmohitagw15856/pm-claude-skills
प्रोडक्ट फ़ीचर, UI बदलाव, ऑनबोर्डिंग फ़्लो और प्राइसिंग प्रयोगों के लिए सांख्यिकीय रूप से कठोर A/B टेस्ट डिज़ाइन करें। जब कोई प्रयोग सेट करने, A/B टेस्ट डिज़ाइन करने, सैंपल साइज़ निकालने या टेस्ट के नतीजे समझाने को कहे, तब इसका उपयोग करें। परिकल्पना, वेरिएंट की परिभाषा, सैंपल साइज़, अवधि का अनुमान, गार्डरेल मेट्रिक और नतीजों की व्याख्या की गाइड के साथ एक पूरा टेस्ट प्लान तैयार करता है।
Accessible Travel Planner
1.6kmohitagw15856/pm-claude-skills
Summarise what Accessible Travel Planner does in one line. Use when asked to [trigger phrases the user would say]. Produces [the concrete artifact].
Headline Options
1.6kmohitagw15856/pm-claude-skills
Generate and pressure-test headline options across proven formulas. Use when asked for headlines, a title, a subject line, a hook, or to improve a weak headline for a page, post, email, or ad. Produces 10–15 headline options grouped by formula (benefit, how-to, number, question, curiosity, social proof), each scored for clarity and specificity, with the top 3 recommended and why.
Cn Zhuanjingtexin Application
1.6kmohitagw15856/pm-claude-skills
Prepare an application under China's tiered SME programme: 创新型中小企业, 专精特新中小企业 and 专精特新小巨人. Identify the right tier, test the company against the specialisation, refinement, distinctiveness and innovation indicators, plan the evidence, and write the application narrative. Use when asked 专精特新怎么申报, 专精特新中小企业认定条件, 小巨人申报条件, 我们够不够专精特新, 创新型中小企业评价, or prepare our Specialised SME application. Produces a tier recommendation, an indicator self-assessment, a gap plan, a materials checklist, narrative sections and a timeline. Not an official assessment.
Animal and Cell Validation Planner
2.1kaipoch/medical-research-skills
Designs cell-based and animal-based validation plans that translate computational, omics, biomarker, genetic, or clinical findings into experimentally testable validation routes. Always use this skill whenever a user wants to move from an in silico, statistical, or clinical association finding toward wet-lab validation using cell systems, organoid-like systems, xenograft or genetically relevant animal models. It should define the exact claim to test, separate mechanism-testing from association-support and translational-support goals, choose the best-fit model family, specify perturbation strat
Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.