Eval

Evaluate and rank agent results by metric or LLM judge for an AgentHub session.

40 stars 11 forksAI, LLMs & Agents Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add ArogyaReddy/alirezarezvani-claude-skills

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add ArogyaReddy/alirezarezvani-claude-skills --skill eval
Manual install
git clone --depth 1 https://github.com/ArogyaReddy/alirezarezvani-claude-skills.git /tmp/alirezarezvani-claude-skills
mkdir -p ~/.claude/skills
cp -r /tmp/alirezarezvani-claude-skills/engineering/agenthub/skills/eval ~/.claude/skills/eval

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# /hub:eval — Evaluate Agent Results

Rank all agent results for a session. Supports metric-based evaluation (run a command), LLM judge (compare diffs), or hybrid.

## Usage

```
/hub:eval                           # Eval latest session using configured criteria
/hub:eval 20260317-143022           # Eval specific session
/hub:eval --judge                   # Force LLM judge mode (ignore metric config)
```

## What It Does

### Metric Mode (eval command configured)

Run the evaluation command in each agent's worktree:

```bash
python {skill_path}/scripts/result_ranker.py \
  --session {session-id} \
  --eval-cmd "{eval_cmd}" \
  --metric {metric} --direction {direction}
```

Output:
```
RANK  AGENT       METRIC      DELTA      FILES
1     agent-2     142ms       -38ms      2
2     agent-1     165ms       -15ms      3
3     agent-3     190ms       +10ms      1

Winner: agent-2 (142ms)
```

### LLM Judge Mode (no eval command, or --judge flag)

For each agent:
1. Get the diff: `git diff {base_branch}...{agent_branch}`
2. Read the agent's result post from `.agenthub/board/results/agent-{i}-result.md`
3. Compare all diffs and rank by:
   - **Correctness** — Does it solve the task?
   - **Simplicity** — Fewer lines changed is better (when equal correctness)
   - **Quality** — Clean execution, good structure, no regressions

Present rankings with justification.

Example LLM judge output for a content task:
Read the full skill on GitHub

Details

Skill name
eval
Path
engineering/agenthub/skills/eval/SKILL.md
License
MIT
Repo updated
17 March 2026

FAQ

What does the Eval skill do?

Evaluate and rank agent results by metric or LLM judge for an AgentHub session.

How do I install the Eval skill?

Claude Code plugin: /plugin marketplace add ArogyaReddy/alirezarezvani-claude-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Eval popular?

It lives in ArogyaReddy/alirezarezvani-claude-skills, which has 40 GitHub stars and 11 forks.

Related skills

AWS Solution Architect

40

ArogyaReddy/alirezarezvani-claude-skills

Design AWS architectures for startups using serverless patterns and IaC templates. Use when asked to design serverless architecture, create CloudFormation templates, optimize AWS costs, set up CI/CD pipelines, or migrate to AWS. Covers Lambda, API Gateway, DynamoDB, ECS, Aurora, and cost optimization.

DevOps & Cloud11

Ceo Advisor

40

ArogyaReddy/alirezarezvani-claude-skills

Executive leadership guidance for strategic decision-making, organizational development, and stakeholder management. Use when planning strategy, preparing board presentations, managing investors, developing organizational culture, making executive decisions, fundraising, or when user mentions CEO, strategic planning, board meetings, investor updates, organizational leadership, or executive strategy.

Productivity & Notes11

Code Reviewer

40

ArogyaReddy/alirezarezvani-claude-skills

Code review automation for TypeScript, JavaScript, Python, Go, Swift, Kotlin. Analyzes PRs for complexity and risk, checks code quality for SOLID violations and code smells, generates review reports. Use when reviewing pull requests, analyzing code quality, identifying issues, generating review checklists.

Software Development11

Init

40

ArogyaReddy/alirezarezvani-claude-skills

Create a new AgentHub collaboration session with task, agent count, and evaluation criteria.

AI, LLMs & Agents11

Esm

43

lifangda/claude-plugins

Comprehensive toolkit for protein language models including ESM3 (generative multimodal protein design across sequence, structure, and function) and ESM C (efficient protein embeddings and representations). Use this skill when working with protein sequences, structures, or function prediction; designing novel proteins; generating protein embeddings; performing inverse folding; or conducting protein engineering tasks. Supports both local model usage and cloud-based Forge API for scalable inference.

AI, LLMs & Agents13

Pymc Bayesian Modeling

43

lifangda/claude-plugins

Bayesian modeling with PyMC. Build hierarchical models, MCMC (NUTS), variational inference, LOO/WAIC comparison, posterior checks, for probabilistic programming and inference.

AI, LLMs & Agents13

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.