Fix Flaky Tests

Investigate and fix flaky or intermittently-failing tests in any framework and CI system — detects the framework, CI provider, and app profile, then applies the matching classification and fix patterns. Triggers on a flaky-test issue or CI URL, a test that "passes on retry" or "fails in CI but passes locally", a bot that skipped a test, or a request to reopen or dispute the closure or diagnosis of a flaky-test issue (for that case open the issue first; its title or label confirms scope even when the prompt has no flaky-test keywords).

280 stars 15 forksTesting & QA Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add intercom/2x-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add intercom/2x-skills --skill fix-flaky-tests
Manual install
git clone --depth 1 https://github.com/intercom/2x-skills.git /tmp/2x-skills
mkdir -p ~/.claude/skills
cp -r /tmp/2x-skills/plugins/test-tools/skills/fix-flaky-tests ~/.claude/skills/fix-flaky-tests

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Fix Flaky Tests

Reference guide for investigating and fixing flaky tests across frameworks (RSpec, Jest,
pytest, Go test, …), CI systems (Buildkite, CircleCI, GitHub Actions, …), and apps. The
methodology is universal; framework idioms, CI log-fetch procedures, and app-specific flake
catalogues are loaded on demand via **progressive discovery**. Compose the workflow to the
situation rather than following rigid steps.

<HARD-RULES>
- NEVER skip a test (xit, skip, pending, `t.Skip`, `.skip`, etc.) as a fix
- NEVER fabricate a root cause — if you can't identify it, say so
- NEVER propose a diagnosis-driven fix without the actual CI error message (exception + backtrace — fetched from the CI logs OR already pasted in the prompt / by the user). The cheap fast exits are the sole exception: already-fixed, bot-skip revert, and broken-not-flaky resolve an issue from git/PR history without a CI error and may open a PR. This rule governs the real investigation that follows a failed fast-exit.
Read the full skill on GitHub

Details

Skill name
fix-flaky-tests
Path
plugins/test-tools/skills/fix-flaky-tests/SKILL.md
License
MIT
Repo updated
11 November 2026

FAQ

What does the Fix Flaky Tests skill do?

Investigate and fix flaky or intermittently-failing tests in any framework and CI system — detects the framework, CI provider, and app profile, then applies the matching classification and fix patterns. Triggers on a flaky-test issue or CI URL, a test that "passes on retry" or "fails in CI but passes locally", a bot that skipped a test, or a request to reopen or dispute the closure or diagnosis of a flaky-test issue (for that case open the issue first; its title or label confirms scope even when the prompt has no flaky-test keywords).

How do I install the Fix Flaky Tests skill?

Claude Code plugin: /plugin marketplace add intercom/2x-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Fix Flaky Tests popular?

It lives in intercom/2x-skills, which has 280 GitHub stars and 15 forks.

Related skills

Attach Github Assets

280

intercom/2x-skills

Upload local files (screenshots, screen recordings, images, videos) to GitHub as user-attachment assets and return markdown-ready URLs for PR descriptions, issue bodies, or PR/issue comments.

Git & Code Review15

Audit Memory

280

intercom/2x-skills

Audit Claude's saved memories for claims that no longer hold true — verify each against current code, PRs and tickets, then archive the stale ones with your approval, and name the MCPs needed for anything unverifiable.

Productivity & Notes15

Cc Cost Analysis

280

intercom/2x-skills

Analyze Claude Code usage costs from OpenTelemetry data — per-user spend, expensive sessions, context bloat, and model/token cost breakdowns — with a structured framework, ready-to-use query shapes, and cost-model formulas. Triggers on "analyze Claude Code costs", "break down the Claude Code bill", "find expensive sessions", "identify context bloat".

AI, LLMs & Agents15

Databricks Synthetic Data Gen

407

databricks/databricks-agent-skills

Generate realistic synthetic data using Spark + Faker (strongly recommended). Supports serverless execution, multiple output formats (Parquet/JSON/CSV/Delta), and scales from thousands to millions of rows. For small datasets (<10K rows), can optionally generate locally and upload to volumes. Use when user mentions 'synthetic data', 'test data', 'generate data', 'demo dataset', 'Faker', or 'sample data'.

Testing & QA103

Experiment Design

298

superhero-tech/superhero-skills

Design concrete assumption tests using prototypes, demand tests or commitment tests. Use when turning research or selected ideas into experiments, comparing test methods or revising an experiment plan.

Testing & QA25

Testing Clickup CLI

132

krodak/clickup-cli

Run and manage tests for clickup-cli. Covers unit tests, e2e tests against a real ClickUp workspace, and the test data setup. Use when running tests, adding test coverage, debugging test failures, or setting up test fixtures.

Testing & QAIn 1 list21

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.