Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session.
Install
/plugin marketplace add ArogyaReddy/alirezarezvani-claude-skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add ArogyaReddy/alirezarezvani-claude-skills --skill evalgit clone --depth 1 https://github.com/ArogyaReddy/alirezarezvani-claude-skills.git /tmp/alirezarezvani-claude-skills
mkdir -p ~/.claude/skills
cp -r /tmp/alirezarezvani-claude-skills/engineering/agenthub/skills/eval ~/.claude/skills/evalPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# /hub:eval — Evaluate Agent Results
Rank all agent results for a session. Supports metric-based evaluation (run a command), LLM judge (compare diffs), or hybrid.
## Usage
```
/hub:eval # Eval latest session using configured criteria
/hub:eval 20260317-143022 # Eval specific session
/hub:eval --judge # Force LLM judge mode (ignore metric config)
```
## What It Does
### Metric Mode (eval command configured)
Run the evaluation command in each agent's worktree:
```bash
python {skill_path}/scripts/result_ranker.py \
--session {session-id} \
--eval-cmd "{eval_cmd}" \
--metric {metric} --direction {direction}
```
Output:
```
RANK AGENT METRIC DELTA FILES
1 agent-2 142ms -38ms 2
2 agent-1 165ms -15ms 3
3 agent-3 190ms +10ms 1
Winner: agent-2 (142ms)
```
### LLM Judge Mode (no eval command, or --judge flag)
For each agent:
1. Get the diff: `git diff {base_branch}...{agent_branch}`
2. Read the agent's result post from `.agenthub/board/results/agent-{i}-result.md`
3. Compare all diffs and rank by:
- **Correctness** — Does it solve the task?
- **Simplicity** — Fewer lines changed is better (when equal correctness)
- **Quality** — Clean execution, good structure, no regressions
Present rankings with justification.
Example LLM judge output for a content task:Details
- Skill name
eval- Repository
- ArogyaReddy/alirezarezvani-claude-skills
- Path
engineering/agenthub/skills/eval/SKILL.md- License
- MIT
- Repo updated
- 17 March 2026
FAQ
What does the Eval skill do?
Evaluate and rank agent results by metric or LLM judge for an AgentHub session.
How do I install the Eval skill?
Claude Code plugin: /plugin marketplace add ArogyaReddy/alirezarezvani-claude-skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Eval popular?
It lives in ArogyaReddy/alirezarezvani-claude-skills, which has 40 GitHub stars and 11 forks.
Related skills
AWS Solution Architect
40ArogyaReddy/alirezarezvani-claude-skills
Design AWS architectures for startups using serverless patterns and IaC templates. Use when asked to design serverless architecture, create CloudFormation templates, optimize AWS costs, set up CI/CD pipelines, or migrate to AWS. Covers Lambda, API Gateway, DynamoDB, ECS, Aurora, and cost optimization.
Ceo Advisor
40ArogyaReddy/alirezarezvani-claude-skills
Executive leadership guidance for strategic decision-making, organizational development, and stakeholder management. Use when planning strategy, preparing board presentations, managing investors, developing organizational culture, making executive decisions, fundraising, or when user mentions CEO, strategic planning, board meetings, investor updates, organizational leadership, or executive strategy.
Code Reviewer
40ArogyaReddy/alirezarezvani-claude-skills
Code review automation for TypeScript, JavaScript, Python, Go, Swift, Kotlin. Analyzes PRs for complexity and risk, checks code quality for SOLID violations and code smells, generates review reports. Use when reviewing pull requests, analyzing code quality, identifying issues, generating review checklists.
Init
40ArogyaReddy/alirezarezvani-claude-skills
Create a new AgentHub collaboration session with task, agent count, and evaluation criteria.
Esm
43lifangda/claude-plugins
Comprehensive toolkit for protein language models including ESM3 (generative multimodal protein design across sequence, structure, and function) and ESM C (efficient protein embeddings and representations). Use this skill when working with protein sequences, structures, or function prediction; designing novel proteins; generating protein embeddings; performing inverse folding; or conducting protein engineering tasks. Supports both local model usage and cloud-based Forge API for scalable inference.
Pymc Bayesian Modeling
43lifangda/claude-plugins
Bayesian modeling with PyMC. Build hierarchical models, MCMC (NUTS), variational inference, LOO/WAIC comparison, posterior checks, for probabilistic programming and inference.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.