Agent Evals
Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates. Use when shipping agent features, validating prompt changes, or gating deployments on quality.
Install
npx skills add huytran1120/vietnam-agentic-skills --skill agent-evalsgit clone --depth 1 https://github.com/huytran1120/vietnam-agentic-skills.git /tmp/vietnam-agentic-skills
mkdir -p ~/.claude/skills
cp -r /tmp/vietnam-agentic-skills/skills/agent-evals ~/.claude/skills/agent-evalsPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Agent Evals Create repeatable checks so agent behavior improves safely over time. ## When to Use This Skill Use this skill when: - Shipping new agent features or changing prompts - Adding CI gates for agent quality and safety - Building regression suites for tool-calling agents - Measuring LLM output quality at scale - Validating RAG retrieval accuracy ## Prerequisites - Python 3.10+ - An LLM API key (OpenAI, Anthropic, etc.) - pytest or a custom eval harness; `pytest-timeout` is required for the shown `--timeout` options - Optional: Braintrust, Promptfoo, or LangSmith account ## Evaluation contract The following are application templates, not bundled executable tests. Supply the `agent` adapter, fixtures, supported provider/model IDs, reviewed dependencies and test configuration. Approve provider cost and data transmission; keep fixtures synthetic and keys private. Sandbox tool effects and inspect tool/network traces, not only response words. Keyword refusals and numerical judge scores do not prove safety or factual accuracy. Define thresholds and human review before evaluating. ## Evaluation Layers ### Unit Evals — Prompt-Level Correctness Test individual prompt → response quality:
Details
- Skill name
agent-evals- Repository
- huytran1120/vietnam-agentic-skills
- Path
skills/agent-evals/SKILL.md- License
- MIT
- Repo updated
- 29 October 2026
- Copies
- Found in 2 GitHub repos
FAQ
What does the Agent Evals skill do?
Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates. Use when shipping agent features, validating prompt changes, or gating deployments on quality.
How do I install the Agent Evals skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add huytran1120/vietnam-agentic-skills --skill agent-evals. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Agent Evals popular?
It lives in huytran1120/vietnam-agentic-skills, which has 9 GitHub stars and 4 forks.
Related skills
Apify Audience Analysis
9huytran1120/vietnam-agentic-skills
Understand audience demographics, preferences, behavior patterns, and engagement quality across Facebook, Instagram, YouTube, and TikTok.
Apify Competitor Intelligence
9huytran1120/vietnam-agentic-skills
Analyze competitor strategies, content, pricing, ads, and market positioning across Google Maps, Booking.com, Facebook, Instagram, YouTube, and TikTok.
Apify Content Analytics
9huytran1120/vietnam-agentic-skills
Track engagement metrics, measure campaign ROI, and analyze content performance across Instagram, Facebook, YouTube, and TikTok.
Agent Evaluation
9huytran1120/vietnam-agentic-skills
Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes, reproducing failures, or running agent regression tests.
Agent Creator
9huytran1120/vietnam-agentic-skills
Create custom AI subagents with proper plugin structure, persona generation, and companion routing skills.
Agent Evaluation Reporting
9huytran1120/vietnam-agentic-skills
Use when summarizing agent evaluations where autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.