Ab Test Setup
Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.
Install
npx skills add huytran1120/vietnam-agentic-skills --skill ab-test-setupgit clone --depth 1 https://github.com/huytran1120/vietnam-agentic-skills.git /tmp/vietnam-agentic-skills
mkdir -p ~/.claude/skills
cp -r /tmp/vietnam-agentic-skills/skills/ab-test-setup ~/.claude/skills/ab-test-setupPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# A/B Test Setup ## 1️⃣ Purpose & Scope Define an experiment that can answer a specific product question, and verify its assumptions before exposing users. This procedure cannot guarantee validity by itself. - Documents the stopping rule - Estimates sample needs under stated assumptions - Makes the hypothesis and decision criteria reviewable --- ## 2️⃣ Pre-Requisites You must have: - A clear user problem - Access to an analytics source - Roughly estimated traffic volume ### Hypothesis Quality Checklist A valid hypothesis includes: - Observation or evidence - Single, specific change - Directional expectation - Defined audience - Measurable success criteria --- ## 3️⃣ Hypothesis Lock (Hard Gate) Before designing variants or metrics, you MUST: - Present the **final hypothesis** - Specify: - Target audience - Primary metric - Expected direction of effect - Minimum Detectable Effect (MDE) Use the hypothesis already agreed in the task. If a launch-critical choice is missing, present the concrete choice for confirmation while continuing independent analysis. Do not repeatedly request approval for a decision already authorized. --- ## 4️⃣ Assumptions & Validity Check (Mandatory) Explicitly list assumptions about: - Traffic stability - User independence - Metric reliability - Randomization quality - External factors (seasonality, campaigns, releases) If assumptions are weak or violated: - Warn the user - Recommend delaying or redesigning the test ---
Details
- Skill name
ab-test-setup- Repository
- huytran1120/vietnam-agentic-skills
- Path
skills/ab-test-setup/SKILL.md- License
- MIT
- Repo updated
- 29 October 2026
- Copies
- Found in 2 GitHub repos
FAQ
What does the Ab Test Setup skill do?
Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.
How do I install the Ab Test Setup skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add huytran1120/vietnam-agentic-skills --skill ab-test-setup. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Ab Test Setup popular?
It lives in huytran1120/vietnam-agentic-skills, which has 9 GitHub stars and 4 forks.
Related skills
Apify Audience Analysis
9huytran1120/vietnam-agentic-skills
Understand audience demographics, preferences, behavior patterns, and engagement quality across Facebook, Instagram, YouTube, and TikTok.
Apify Competitor Intelligence
9huytran1120/vietnam-agentic-skills
Analyze competitor strategies, content, pricing, ads, and market positioning across Google Maps, Booking.com, Facebook, Instagram, YouTube, and TikTok.
Apify Content Analytics
9huytran1120/vietnam-agentic-skills
Track engagement metrics, measure campaign ROI, and analyze content performance across Instagram, Facebook, YouTube, and TikTok.
Ab Testing
9huytran1120/vietnam-agentic-skills
When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.
Test Scenarios
9tarunccet/pm-skills
Create comprehensive test scenarios from user stories with test objectives, starting conditions, user roles, step-by-step actions, and expected outcomes. Use when writing QA test cases, creating test plans, defining acceptance tests, or preparing for feature validation.
Agent QA Authoring
9huytran1120/vietnam-agentic-skills
Create, edit, validate, and run Agent QA tests, suites, and hooks through MCP or CLI while preserving canonical IDs and schema contracts.
Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.