Stat Hypothesis Testing

Conduct statistical hypothesis testing including null/alternative hypothesis formulation, p-values, Type I/II errors, and test statistic selection. Use this skill when the user needs to determine whether a result is statistically significant, choose the right statistical test, interpret p-values correctly, or evaluate research findings — even if they say 'is this result significant', 'which statistical test should I use', or 'what does this p-value mean'.

248 stars 30 forksTesting & QA

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add asgard-ai-platform/skills --skill stat-hypothesis-testing
Manual install
git clone --depth 1 https://github.com/asgard-ai-platform/skills.git /tmp/skills
mkdir -p ~/.claude/skills
cp -r /tmp/skills/stat-hypothesis-testing ~/.claude/skills/stat-hypothesis-testing

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Hypothesis Testing

## Framework

```
IRON LAW: Statistical Significance ≠ Practical Significance

A p-value < 0.05 means the result is unlikely under the null hypothesis.
It does NOT mean the result is important, large, or practically meaningful.
With a large enough sample, a 0.1% conversion rate difference becomes
"statistically significant" but is practically worthless.

ALWAYS report effect size alongside p-value.
```

```
IRON LAW: State Hypotheses BEFORE Looking at Data

H₀ (null) and H₁ (alternative) must be defined before data analysis.
Choosing hypotheses after seeing the data = p-hacking = scientific fraud.
"We found an interesting pattern, let's test it on the same data" is invalid.
```

### Core Concepts

| Concept | Definition |
|---------|-----------|
| **H₀ (Null)** | Default assumption: no effect, no difference |
| **H₁ (Alternative)** | What you want to show: there IS an effect/difference |
| **p-value** | Probability of seeing this result (or more extreme) IF H₀ is true |
| **α (significance level)** | Threshold for rejecting H₀ (typically 0.05) |
| **Type I error (α)** | Rejecting H₀ when it's actually true (false positive) |
| **Type II error (β)** | Failing to reject H₀ when H₁ is true (false negative) |
| **Power (1-β)** | Probability of detecting a real effect (target: ≥ 0.8) |
| **Effect size** | Magnitude of the difference (Cohen's d, odds ratio, R²) |

### Test Selection Guide

| Data Type | Groups | Test |
|-----------|--------|------|
Read the full skill on GitHub

Details

Skill name
stat-hypothesis-testing
Path
stat-hypothesis-testing/SKILL.md
License
MIT
Repo updated
6 June 2026

FAQ

What does the Stat Hypothesis Testing skill do?

Conduct statistical hypothesis testing including null/alternative hypothesis formulation, p-values, Type I/II errors, and test statistic selection. Use this skill when the user needs to determine whether a result is statistically significant, choose the right statistical test, interpret p-values correctly, or evaluate research findings — even if they say 'is this result significant', 'which statistical test should I use', or 'what does this p-value mean'.

How do I install the Stat Hypothesis Testing skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add asgard-ai-platform/skills --skill stat-hypothesis-testing. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Stat Hypothesis Testing popular?

It lives in asgard-ai-platform/skills, which has 248 GitHub stars and 30 forks.

Related skills

Algo Ad Bidding

248

asgard-ai-platform/skills

Implement and select ad bidding strategies from manual CPC to automated target-CPA and target-ROAS. Use this skill when the user needs to choose a bidding strategy, set up automated bidding, or optimize bid parameters — even if they say 'what bidding strategy should I use', 'target CPA setup', or 'smart bidding configuration'.

Marketing, Sales & Business30

Algo Ad Budget

248

asgard-ai-platform/skills

Optimize advertising budget allocation across campaigns using marginal returns analysis. Use this skill when the user needs to distribute budget across multiple campaigns, optimize spend pacing, or maximize overall ROAS under budget constraints — even if they say 'how to split my ad budget', 'campaign budget optimization', or 'diminishing returns on ad spend'.

Marketing, Sales & Business30

Algo Ad Ctr

248

asgard-ai-platform/skills

Build CTR prediction models for estimating ad click-through rates from features. Use this skill when the user needs to predict click probability, build an ad ranking model, or evaluate ad creative performance — even if they say 'predict click rate', 'ad relevance scoring', or 'which ad will get more clicks'.

Marketing, Sales & Business30

Browser Uat Analyst

110

microsoft/cat-agent-skills

Use this skill whenever the user asks to test, validate, UAT, regression-check, or investigate the behaviour of a browser-based application — including Copilot Studio agents, Power Platform apps and flows, Dataverse, Dynamics 365, Microsoft 365 admin centres, Teams web, and custom web apps. Covers test charter design, Playwright-driven execution, screenshot evidence capture, expected-vs-observed analysis, and stakeholder reporting. Use it BEFORE claiming any UI behaviour works or is broken. Do NOT use this skill for unit tests, API-only contract tests, or load testing.

Testing & QA122

Stat Ab Testing

248

asgard-ai-platform/skills

Design and analyze A/B tests with proper statistical methodology including sample size calculation, randomization, frequentist and Bayesian approaches, and sequential testing. Use this skill when the user needs to set up an experiment, calculate required sample size, interpret test results, or decide between testing methodologies — even if they say 'should we A/B test this', 'how many users do we need', 'is the test result conclusive', or 'can we stop the test early'.

Testing & QA30

Classic Text Adventure

110

microsoft/cat-agent-skills

Play and operate a deterministic, resumable Colossal Cave text adventure with verbatim game output and an OOC escape. Use when a user asks to start, continue, inspect, reset, or smoke-test the Classic Text Adventure; treat unprefixed messages as game commands while a session is active.

Testing & QA122

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.