Exp Lens Benchmark Representativeness

Create Benchmark Representativeness experimental design diagram showing coverage matrix, generalization gaps, and untested regions. Generalizability lens answering "Does this generalize beyond the test bed?

5 stars 1 forksTesting & QA

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add TalonT-Org/AutoSkillit --skill exp-lens-benchmark-representativeness
Manual install
git clone --depth 1 https://github.com/TalonT-Org/AutoSkillit.git /tmp/AutoSkillit
mkdir -p ~/.claude/skills
cp -r /tmp/AutoSkillit/src/autoskillit/skills_extended/exp-lens-benchmark-representativeness ~/.claude/skills/exp-lens-benchmark-representativeness

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Benchmark Representativeness Experimental Design Lens

**Philosophical Mode:** Generalizability
**Primary Question:** "Does this generalize beyond the test bed?"
**Focus:** Task Distribution, Scenario Coverage, Missing Regions, Dataset Selection, Generalization Claims

## Arguments

`/autoskillit:exp-lens-benchmark-representativeness [context_path] [experiment_plan_path]`

- **context_path** (optional positional arg 1) — Absolute path to a lens context file
  containing IV/DV tables, H0/H1 hypotheses, controlled variables, and success criteria.
  If provided, read this file before beginning analysis to obtain structured context.
  If omitted, discover context by exploring the CWD.
- **experiment_plan_path** (optional positional arg 2) — Absolute path to the full
  experiment plan. If provided, read for complete experimental methodology and design.
  If omitted, locate the experiment plan by exploring the CWD.

## When to Use

- Evaluating claims that extend beyond specific benchmarks
- Checking coverage of evaluation suite
- Assessing dataset diversity
- User invokes `/autoskillit:exp-lens-benchmark-representativeness` or `/autoskillit:make-experiment-diag benchmark`

## Critical Constraints

**NEVER:**
- Modify any source code files
- Do not litter the codebase with useless comments, TODO markers, or explanatory annotations — the skill output and diagram speak for themselves
- Create files outside `{{AUTOSKILLIT_TEMP}}/exp-lens-benchmark-representativeness/`
Read the full skill on GitHub

Details

Skill name
exp-lens-benchmark-representativeness
Path
src/autoskillit/skills_extended/exp-lens-benchmark-representativeness/SKILL.md
License
MIT
Repo updated
8 November 2026

FAQ

What does the Exp Lens Benchmark Representativeness skill do?

Create Benchmark Representativeness experimental design diagram showing coverage matrix, generalization gaps, and untested regions. Generalizability lens answering "Does this generalize beyond the test bed?

How do I install the Exp Lens Benchmark Representativeness skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add TalonT-Org/AutoSkillit --skill exp-lens-benchmark-representativeness. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Exp Lens Benchmark Representativeness popular?

It lives in TalonT-Org/AutoSkillit, which has 5 GitHub stars and 1 forks.

Related skills

Analyze Prs

5

TalonT-Org/AutoSkillit

Analyze all open PRs targeting a base branch — determine merge order, identify file overlaps, and tag each PR as simple or needs_check for complexity. Use at the start of a PR consolidation workflow.

Git & Code Review

Arch Lens C4 Container

5

TalonT-Org/AutoSkillit

Create C4 Container architecture diagram showing static structure, building blocks, and technology choices. Anatomical lens answering "How is it built?

Software Development

Arch Lens Concurrency

5

TalonT-Org/AutoSkillit

Create Concurrency architecture diagram showing parallel execution patterns, thread pools, synchronization, and barriers. Physiological lens answering "How does parallelism work?

Software Development

Exp Lens Exploratory Confirmatory

5

TalonT-Org/AutoSkillit

Assess whether analytic decisions were pre-specified or post-hoc and whether exploratory/confirmatory norms are aligned. Boundary lens answering "Is this discovery or test, and are norms aligned?

Testing & QA

Design Guards

5

TalonT-Org/AutoSkillit

Investigate a bug pattern audit report and design architectural guards (tests, contracts, structural changes) that provide immunity to each identified pattern. Use when user says "design guards", "design defenses", or wants architectural solutions for bug patterns.

Testing & QA

Exp Lens Severity Testing

5

TalonT-Org/AutoSkillit

Analyze severity of experimental tests — adversarial cases, negative controls, falsification tests, easy-pass detection, and confirmatory theater. Falsificationist lens answering "Would this design have caught the error?

Testing & QA

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.