Exp Lens Fair Comparison

Create a comparison fairness matrix assessing whether alternatives are evaluated under symmetric constraints. Fairness lens answering "Are alternatives compared under symmetric constraints?

5 stars 1 forksOther

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add TalonT-Org/AutoSkillit --skill exp-lens-fair-comparison
Manual install
git clone --depth 1 https://github.com/TalonT-Org/AutoSkillit.git /tmp/AutoSkillit
mkdir -p ~/.claude/skills
cp -r /tmp/AutoSkillit/src/autoskillit/skills_extended/exp-lens-fair-comparison ~/.claude/skills/exp-lens-fair-comparison

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Fair Comparison Experimental Design Lens

**Philosophical Mode:** Fairness
**Primary Question:** "Are alternatives compared under symmetric constraints?"
**Focus:** Compute Budget Symmetry, Tuning Protocol Parity, Data Access Equality, Engineering Effort Balance, Winner's Curse

## Arguments

`/autoskillit:exp-lens-fair-comparison [context_path] [experiment_plan_path]`

- **context_path** (optional positional arg 1) — Absolute path to a lens context file
  containing IV/DV tables, H0/H1 hypotheses, controlled variables, and success criteria.
  If provided, read this file before beginning analysis to obtain structured context.
  If omitted, discover context by exploring the CWD.
- **experiment_plan_path** (optional positional arg 2) — Absolute path to the full
  experiment plan. If provided, read for complete experimental methodology and design.
  If omitted, locate the experiment plan by exploring the CWD.

## When to Use

- Method comparisons where tuning effort differs
- Benchmark results where compute budgets are unequal
- Claims of SOTA that may reflect process differences
- User invokes `/autoskillit:exp-lens-fair-comparison` or `/autoskillit:make-experiment-diag fairness`

## Critical Constraints

**NEVER:**
- Modify any source code files
- Do not litter the codebase with useless comments, TODO markers, or explanatory annotations — the skill output and diagram speak for themselves
- Create files outside `{{AUTOSKILLIT_TEMP}}/exp-lens-fair-comparison/`
Read the full skill on GitHub

Details

Skill name
exp-lens-fair-comparison
Path
src/autoskillit/skills_extended/exp-lens-fair-comparison/SKILL.md
License
MIT
Repo updated
8 November 2026

FAQ

What does the Exp Lens Fair Comparison skill do?

Create a comparison fairness matrix assessing whether alternatives are evaluated under symmetric constraints. Fairness lens answering "Are alternatives compared under symmetric constraints?

How do I install the Exp Lens Fair Comparison skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add TalonT-Org/AutoSkillit --skill exp-lens-fair-comparison. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Exp Lens Fair Comparison popular?

It lives in TalonT-Org/AutoSkillit, which has 5 GitHub stars and 1 forks.

Related skills

Analyze Prs

5

TalonT-Org/AutoSkillit

Analyze all open PRs targeting a base branch — determine merge order, identify file overlaps, and tag each PR as simple or needs_check for complexity. Use at the start of a PR consolidation workflow.

Git & Code Review

Arch Lens C4 Container

5

TalonT-Org/AutoSkillit

Create C4 Container architecture diagram showing static structure, building blocks, and technology choices. Anatomical lens answering "How is it built?

Software Development

Arch Lens Concurrency

5

TalonT-Org/AutoSkillit

Create Concurrency architecture diagram showing parallel execution patterns, thread pools, synchronization, and barriers. Physiological lens answering "How does parallelism work?

Software Development

Exp Lens Measurement Validity

5

TalonT-Org/AutoSkillit

Analyze measurement validity for experimental design — auditing metric-construct alignment, proxy validity, reliability, sensitivity, and consequential validity. Argumentative lens answering "Do measurements justify the interpretation?

Other

Exp Lens Comparator Construction

5

TalonT-Org/AutoSkillit

Create Comparator Construction experimental design analysis assessing whether baselines and controls are fair and relevant. Counterfactual lens answering "Is the comparator fair and relevant?

Other

Exp Lens Pipeline Integrity

5

TalonT-Org/AutoSkillit

Create Pipeline Integrity experimental design diagram showing data splits, leakage points, preprocessing order, and label contamination. Integrity lens answering "Could data handling create optimistic bias?

Other

Browse the most popular Claude skills, all other skills, or write your own with the skills generator.