Failure Taxonomy
Classifying AI failures — hallucination, refusal, irrelevance, tone mismatch, latency.
Install
/plugin marketplace add Owl-Listener/ai-design-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add Owl-Listener/ai-design-skills --skill failure-taxonomygit clone --depth 1 https://github.com/Owl-Listener/ai-design-skills.git /tmp/ai-design-skills
mkdir -p ~/.claude/skills
cp -r /tmp/ai-design-skills/claude-plugin/evaluation/skills/failure-taxonomy ~/.claude/skills/failure-taxonomyPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Failure Taxonomy Not all AI failures are the same. A hallucination is different from a refusal, which is different from a tone mismatch. A failure taxonomy classifies failure types so teams can track, prioritise, and address them systematically. ## Failure Categories **Content Failures:** - **Hallucination**: The AI presents false information as fact - **Inaccuracy**: The AI gets details wrong (dates, numbers, names) - **Incompleteness**: The AI misses important information - **Irrelevance**: The AI's response doesn't address the user's actual question - **Contradiction**: The AI contradicts itself within or across responses **Behavioral Failures:** - **Inappropriate refusal**: The AI refuses a reasonable request - **Missing refusal**: The AI fulfils a request it should have declined - **Tone mismatch**: The AI's tone is wrong for the context - **Persona break**: The AI drops out of its defined persona - **Over-generation**: The AI produces far more than needed **Technical Failures:** - **Latency**: Response takes too long - **Truncation**: Response is cut off - **Format errors**: Output is in the wrong format or structure - **Tool failures**: The AI attempts to use a tool and fails - **Context loss**: The AI loses track of conversation history **Safety Failures:** - **Harmful content**: The AI generates content that could cause harm - **Privacy violation**: The AI reveals sensitive information - **Bias manifestation**: The AI's output shows bias against a group
Details
- Skill name
failure-taxonomy- Repository
- Owl-Listener/ai-design-skills
- Path
claude-plugin/evaluation/skills/failure-taxonomy/SKILL.md- License
- MIT
- Repo updated
- 9 June 2026
FAQ
What does the Failure Taxonomy skill do?
Classifying AI failures — hallucination, refusal, irrelevance, tone mismatch, latency.
How do I install the Failure Taxonomy skill?
Claude Code plugin: /plugin marketplace add Owl-Listener/ai-design-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Failure Taxonomy popular?
It lives in Owl-Listener/ai-design-skills, which has 207 GitHub stars and 37 forks.
Related skills
Agent Role Design
207Owl-Listener/ai-design-skills
Defining what each agent does, knows, and owns in a multi-agent system.
Behavioral Consistency
207Owl-Listener/ai-design-skills
Ensuring the AI behaves predictably across sessions, edge cases, and modalities.
Bias Detection Design
207Owl-Listener/ai-design-skills
Designing review workflows to surface and mitigate bias in AI outputs.
Few Shot Patterns
207Owl-Listener/ai-design-skills
Crafting examples that steer AI behavior effectively.
Failure Recovery
207Owl-Listener/ai-design-skills
What happens when an agent fails — retry, fallback, escalate, or graceful degradation.
Handoff Protocols
207Owl-Listener/ai-design-skills
Designing smooth transitions between agents and between AI and humans.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.