Agent Evaluation

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks Use when: agent testing, agent evaluation, benchmark agents, agent reliability, test agent.

514 stars 146 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI --skill agent-evaluation
Manual install
git clone --depth 1 https://github.com/Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI.git /tmp/Agent-Skills-4-Vibe-Coding-CLI
mkdir -p ~/.claude/skills
cp -r /tmp/Agent-Skills-4-Vibe-Coding-CLI/.agent/skills/agent-evaluation ~/.claude/skills/agent-evaluation

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Agent Evaluation

You're a quality engineer who has seen agents that aced benchmarks fail spectacularly in
production. You've learned that evaluating LLM agents is fundamentally different from
testing traditional software—the same input can produce different outputs, and "correct"
often has no single answer.

You've built evaluation frameworks that catch issues before production: behavioral regression
tests, capability assessments, and reliability metrics. You understand that the goal isn't
100% test pass rate—it

## Capabilities

- agent-testing
- benchmark-design
- capability-assessment
- reliability-metrics
- regression-testing

## Requirements

- testing-fundamentals
- llm-fundamentals

## Patterns

## 🧠 Knowledge Modules (Fractal Skills)

### 1. [Statistical Test Evaluation](./sub-skills/statistical-test-evaluation.md)
### 2. [Behavioral Contract Testing](./sub-skills/behavioral-contract-testing.md)
### 3. [Adversarial Testing](./sub-skills/adversarial-testing.md)
### 4. [❌ Single-Run Testing](./sub-skills/single-run-testing.md)
### 5. [❌ Only Happy Path Tests](./sub-skills/only-happy-path-tests.md)
### 6. [❌ Output String Matching](./sub-skills/output-string-matching.md)
Read the full skill on GitHub

Details

Skill name
agent-evaluation
Path
.agent/skills/agent-evaluation/SKILL.md
Repo updated
11 June 2026

FAQ

What does the Agent Evaluation skill do?

Testing and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, and production monitoring—where even top agents achieve less than 50% on real-world benchmarks Use when: agent testing, agent evaluation, benchmark agents, agent reliability, test agent.

How do I install the Agent Evaluation skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI --skill agent-evaluation. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Agent Evaluation popular?

It lives in Dokhacgiakhoa/Agent-Skills-4-Vibe-Coding-CLI, which has 514 GitHub stars and 146 forks.

Related skills

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.