Agent Evaluation

Use when testing skills, commands, or agents for quality. Use after creating new skills, before deploying agents, or when debugging inconsistent agent behavior. Triggers on "evaluate", "test quality", "is this skill working", or QA of AI workflows.

150 stars 32 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add guia-matthieu/clawfu-skills --skill agent-evaluation
Manual install
git clone --depth 1 https://github.com/guia-matthieu/clawfu-skills.git /tmp/clawfu-skills
mkdir -p ~/.claude/skills
cp -r /tmp/clawfu-skills/skills/meta/agent-evaluation ~/.claude/skills/agent-evaluation

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Agent Evaluation

## Overview

**Core principle:** Agents are non-deterministic. Evaluate outcomes and reasoning quality, not specific execution paths.

Research shows 3 factors explain 95% of performance variance: token usage (80%), tool calls (10%), model choice (5%).

## When to Use

- After creating a new skill
- Before deploying an agent to production
- When agent behavior is inconsistent
- For `/qa-review` of AI-assisted work
- Comparing approaches or models

## Quick Reference: 5-Dimension Rubric

| Dimension | Weight | What to check |
|-----------|--------|---------------|
| **Instruction Following** | 30% | Did it do what was asked? |
| **Output Completeness** | 25% | Are all requirements covered? |
| **Tool Efficiency** | 20% | Minimal, appropriate tool use? |
| **Reasoning Quality** | 15% | Is the logic sound? |
| **Response Coherence** | 10% | Clear, well-structured? |

**Pass threshold:** 0.70 (general), 0.85 (critical operations)

## Evaluation Methods

### 1. Direct Scoring (Fast)

For quick skill checks:

```markdown
## Evaluation: [Skill/Agent Name]

**Test case:** [What was asked]
**Output:** [What was produced]

### Scores (0.0-1.0)

| Dimension | Score | Justification |
|-----------|-------|---------------|
| Instruction Following | X.X | [Why] |
| Output Completeness | X.X | [Why] |
| Tool Efficiency | X.X | [Why] |
| Reasoning Quality | X.X | [Why] |
| Response Coherence | X.X | [Why] |

**Weighted Total:** X.XX
**Pass/Fail:** [PASS if ≥0.70]
```
Read the full skill on GitHub

Details

Skill name
agent-evaluation
Path
skills/meta/agent-evaluation/SKILL.md
License
MIT
Repo updated
1 October 2026

FAQ

What does the Agent Evaluation skill do?

Use when testing skills, commands, or agents for quality. Use after creating new skills, before deploying agents, or when debugging inconsistent agent behavior. Triggers on "evaluate", "test quality", "is this skill working", or QA of AI workflows.

How do I install the Agent Evaluation skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add guia-matthieu/clawfu-skills --skill agent-evaluation. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Agent Evaluation popular?

It lives in guia-matthieu/clawfu-skills, which has 150 GitHub stars and 32 forks, and is included in 1 curated skill list.

Related skills

Aarrr Metrics

150

guia-matthieu/clawfu-skills

Measure and optimize growth using the AARRR (Pirate Metrics) framework with stage-specific KPIs and funnel analysis

Marketing, Sales & BusinessIn 1 list32

Ab Test Stats

150

guia-matthieu/clawfu-skills

Calculate A/B test statistical significance. Use when: determining if test results are significant; calculating required sample size; estimating test duration; analyzing conversion experiments; making data-driven decisions

Testing & QAIn 1 list32

Account Health

150

guia-matthieu/clawfu-skills

Assess customer account health using product usage, support sentiment, payment status, and relationship signals

Finance & CryptoIn 1 list32

Agents SDK

201

swyxio/skills

Build or debug stateful applications that specifically use Cloudflare's `agents` package, including Agent classes, routing, callable methods, synchronized state, scheduling, AIChatAgent, durable execution, or Agents SDK client hooks. Do not trigger for generic AI-agent design, the OpenAI Agents SDK, or ordinary Durable Object work that does not use the Cloudflare Agents SDK.

AI, LLMs & Agents12

Agent Bootstrap

191

jwynia/agent-skills

Bootstrap agentic development environment from agent.toml manifest

AI, LLMs & Agents24

AI Bot Log Audit

150

guia-matthieu/clawfu-skills

Use when analyzing server logs to understand how AI crawlers (GPTBot, ClaudeBot, PerplexityBot) interact with your site. Use when optimizing content placement for LLM retrieval, diagnosing why AI search isn't citing your content, or auditing crawl patterns to find optimization gaps.

AI, LLMs & AgentsIn 1 list32

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.