Failure Taxonomy

Classifying AI failures — hallucination, refusal, irrelevance, tone mismatch, latency.

207 stars 37 forksAI, LLMs & Agents Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add Owl-Listener/ai-design-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add Owl-Listener/ai-design-skills --skill failure-taxonomy
Manual install
git clone --depth 1 https://github.com/Owl-Listener/ai-design-skills.git /tmp/ai-design-skills
mkdir -p ~/.claude/skills
cp -r /tmp/ai-design-skills/claude-plugin/evaluation/skills/failure-taxonomy ~/.claude/skills/failure-taxonomy

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Failure Taxonomy
Not all AI failures are the same. A hallucination is different from a refusal, which is different from a tone mismatch. A failure taxonomy classifies failure types so teams can track, prioritise, and address them systematically.
## Failure Categories
**Content Failures:**
- **Hallucination**: The AI presents false information as fact
- **Inaccuracy**: The AI gets details wrong (dates, numbers, names)
- **Incompleteness**: The AI misses important information
- **Irrelevance**: The AI's response doesn't address the user's actual question
- **Contradiction**: The AI contradicts itself within or across responses
**Behavioral Failures:**
- **Inappropriate refusal**: The AI refuses a reasonable request
- **Missing refusal**: The AI fulfils a request it should have declined
- **Tone mismatch**: The AI's tone is wrong for the context
- **Persona break**: The AI drops out of its defined persona
- **Over-generation**: The AI produces far more than needed
**Technical Failures:**
- **Latency**: Response takes too long
- **Truncation**: Response is cut off
- **Format errors**: Output is in the wrong format or structure
- **Tool failures**: The AI attempts to use a tool and fails
- **Context loss**: The AI loses track of conversation history
**Safety Failures:**
- **Harmful content**: The AI generates content that could cause harm
- **Privacy violation**: The AI reveals sensitive information
- **Bias manifestation**: The AI's output shows bias against a group
Read the full skill on GitHub

Details

Skill name
failure-taxonomy
Path
claude-plugin/evaluation/skills/failure-taxonomy/SKILL.md
License
MIT
Repo updated
9 June 2026

FAQ

What does the Failure Taxonomy skill do?

Classifying AI failures — hallucination, refusal, irrelevance, tone mismatch, latency.

How do I install the Failure Taxonomy skill?

Claude Code plugin: /plugin marketplace add Owl-Listener/ai-design-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Failure Taxonomy popular?

It lives in Owl-Listener/ai-design-skills, which has 207 GitHub stars and 37 forks.

Related skills

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.