Spot AI Mistakes

Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors. Use when asked how do I know when AI is wrong, what are AI's common mistakes, how do I catch AI errors, or where does AI mess up. Produces the failure patterns most relevant to how you use AI (hallucinated facts, fake citations, outdated info, sycophancy, math slips, missed nuance), the tells that give each away, a quick check for the ones that would hurt you, and a calibrated trust level — so you develop the instinct to catch

1,573 stars 281 forksAI, LLMs & Agents Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add mohitagw15856/pm-claude-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add mohitagw15856/pm-claude-skills --skill spot-ai-mistakes
Manual install
git clone --depth 1 https://github.com/mohitagw15856/pm-claude-skills.git /tmp/pm-claude-skills
mkdir -p ~/.claude/skills
cp -r /tmp/pm-claude-skills/plugins/pm-ai-native/skills/spot-ai-mistakes ~/.claude/skills/spot-ai-mistakes

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Spot AI Mistakes

AI fails in patterned, learnable ways — it invents citations, states outdated facts with total confidence, agrees with whatever you imply, and fumbles arithmetic while sounding certain. Once you know the patterns and their tells, you catch most errors on sight. This maps the failure modes most relevant to how *you* use AI, the signs that give each away, and a fast check for the ones that would actually hurt — building the instinct so confident-wrong stops catching you off guard.

## What This Skill Produces

- **The failure patterns that matter for you** — the specific ways AI goes wrong in your use (hallucinated facts, fabricated citations/quotes, outdated info, sycophancy, arithmetic slips, false precision, missed nuance, confident guessing)
- **The tells for each** — the signals that give a mistake away (suspiciously specific sources, confidence on recent/niche topics, agreeing too readily, round-number math)
- **A fast check for the dangerous ones** — a quick way to catch the errors that would actually cost you, without over-checking everything
- **A calibrated trust level** — where AI is reliable for your uses and where it isn't, so trust is earned per-domain not blanket
- **The instinct, built** — the habit of pattern-matching for these tells as you read AI output

## Required Inputs

Ask for these if not provided:
- **How you use AI** — the domains and tasks (points at which failure modes matter most)
Read the full skill on GitHub

Details

Skill name
spot-ai-mistakes
Path
plugins/pm-ai-native/skills/spot-ai-mistakes/SKILL.md
License
MIT
Repo updated
18 November 2026

FAQ

What does the Spot AI Mistakes skill do?

Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors. Use when asked how do I know when AI is wrong, what are AI's common mistakes, how do I catch AI errors, or where does AI mess up. Produces the failure patterns most relevant to how you use AI (hallucinated facts, fake citations, outdated info, sycophancy, math slips, missed nuance), the tells that give each away, a quick check for the ones that would hurt you, and a calibrated trust level — so you develop the instinct to catch

How do I install the Spot AI Mistakes skill?

Claude Code plugin: /plugin marketplace add mohitagw15856/pm-claude-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Spot AI Mistakes popular?

It lives in mohitagw15856/pm-claude-skills, which has 1,573 GitHub stars and 281 forks, and is included in 1 curated skill list.

Related skills

Ab Test Planner

1.6k

mohitagw15856/pm-claude-skills

Diseña pruebas A/B estadísticamente rigurosas para características de producto, cambios de UI, flujos de onboarding y experimentos de precios. Úsalo cuando te pidan configurar un experimento, diseñar una prueba A/B, calcular tamaño de muestra o interpretar resultados de pruebas. Produce un plan de prueba completo con hipótesis, definición de variantes, tamaño de muestra, estimación de duración, métricas de seguridad y una guía de interpretación de resultados.

Testing & QAIn 1 list281

Ab Test Planner

1.6k

mohitagw15856/pm-claude-skills

प्रोडक्ट फ़ीचर, UI बदलाव, ऑनबोर्डिंग फ़्लो और प्राइसिंग प्रयोगों के लिए सांख्यिकीय रूप से कठोर A/B टेस्ट डिज़ाइन करें। जब कोई प्रयोग सेट करने, A/B टेस्ट डिज़ाइन करने, सैंपल साइज़ निकालने या टेस्ट के नतीजे समझाने को कहे, तब इसका उपयोग करें। परिकल्पना, वेरिएंट की परिभाषा, सैंपल साइज़, अवधि का अनुमान, गार्डरेल मेट्रिक और नतीजों की व्याख्या की गाइड के साथ एक पूरा टेस्ट प्लान तैयार करता है।

Testing & QAIn 1 list281

Accessible Travel Planner

1.6k

mohitagw15856/pm-claude-skills

Summarise what Accessible Travel Planner does in one line. Use when asked to [trigger phrases the user would say]. Produces [the concrete artifact].

Frontend & DesignIn 1 list281

Support Staffing Model

1.6k

mohitagw15856/pm-claude-skills

How many support agents does the queue actually need — Erlang C, computed, not 'tickets per agent' folklore. Use when staffing a support/CS team, defending headcount, or checking whether an SLA is mathematically possible with the current roster. Produces agent counts across load scenarios (with shrinkage), occupancy and average-wait numbers, and a real .xlsx — via the bundled zero-dependency script.

AI, LLMs & AgentsIn 1 list281

Solar Breakeven

1.6k

mohitagw15856/pm-claude-skills

Model whether solar panels pay for themselves for your roof — net cost after incentives, bill offset with degradation, electricity inflation, the inverter replacement, and the breakeven year, plus the policy risk no calculator controls. Use when asked are solar panels worth it, when does solar break even, check this solar quote's payback claim, or model solar for my bill. Produces the year-by-year table from the script, the breakeven year, the quote-vs-model comparison, and the not-modeled list led by net-metering risk.

AI, LLMs & AgentsIn 1 list281

External Model Validation

2.1k

aipoch/medical-research-skills

Use when validating an existing prognostic risk signature on an external bulk expression cohort with survival outcomes, producing risk scores, Kaplan-Meier curves, risk distribution plots, heatmap, and time-dependent ROC curves. NOT for: model training, feature selection, nomogram construction, calibration analysis, or single-cell data.

AI, LLMs & Agents206

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.