Graphrag Evaluation

Evaluates GraphRAG systems across knowledge graph completeness, retrieval relevance, answer correctness, reasoning depth, and hallucination prevention. Provides structured evaluation frameworks, metric selection guidance, and testing protocols. Use when evaluating GraphRAG quality, benchmarking multi-step reasoning, measuring hallucination reduction, or when user mentions evaluate GraphRAG, quality metrics, answer correctness, test my GraphRAG, or measure RAG performance.

200 stars 25 forksTesting & QA Plugin marketplace

Install

Claude Code plugin
/plugin marketplace add lyndonkl/claude

The repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add lyndonkl/claude --skill graphrag-evaluation
Manual install
git clone --depth 1 https://github.com/lyndonkl/claude.git /tmp/claude
mkdir -p ~/.claude/skills
cp -r /tmp/claude/skills/graphrag-evaluation ~/.claude/skills/graphrag-evaluation

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

## Table of Contents
- [Workflow](#workflow)
- [Evaluation Dimensions](#evaluation-dimensions)
- [Metric Selection Guide](#metric-selection-guide)
- [Output Template](#output-template)

# GraphRAG Evaluation

## Workflow

Copy this checklist and work through each step:

- [ ] Step 1. Identify Evaluation Scope
- [ ] Step 2. Select Metrics
- [ ] Step 3. Design Test Protocol
- [ ] Step 4. Test Reasoning Capabilities
- [ ] Step 5. Measure Hallucination Rate
- [ ] Step 6. Compare Against Baselines
- [ ] Step 7. Produce Evaluation Report

### Step 1. Identify Evaluation Scope

Define what aspects of your GraphRAG system you need to evaluate and why. Determine whether you are evaluating the full pipeline or specific components (KG construction, retrieval, generation). Clarify the use case context: domain, query complexity, expected reasoning depth.

See [methodology.md](resources/methodology.md) for the full evaluation dimensions framework.

### Step 2. Select Metrics

Choose metrics appropriate to your evaluation scope. Not every evaluation requires every metric. Match metrics to your system's maturity and the questions you need answered.

See the **Metric Selection Guide** below and [methodology.md](resources/methodology.md) for detailed metric definitions.

### Step 3. Design Test Protocol
Read the full skill on GitHub

Details

Skill name
graphrag-evaluation
Path
skills/graphrag-evaluation/SKILL.md
Repo updated
1 September 2026

FAQ

What does the Graphrag Evaluation skill do?

Evaluates GraphRAG systems across knowledge graph completeness, retrieval relevance, answer correctness, reasoning depth, and hallucination prevention. Provides structured evaluation frameworks, metric selection guidance, and testing protocols. Use when evaluating GraphRAG quality, benchmarking multi-step reasoning, measuring hallucination reduction, or when user mentions evaluate GraphRAG, quality metrics, answer correctness, test my GraphRAG, or measure RAG performance.

How do I install the Graphrag Evaluation skill?

Claude Code plugin: /plugin marketplace add lyndonkl/claude. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Graphrag Evaluation popular?

It lives in lyndonkl/claude, which has 200 GitHub stars and 25 forks.

Related skills

Abstraction Concrete Examples

200

lyndonkl/claude

Builds structured abstraction ladders that translate high-level principles into concrete, actionable examples across 3-5 levels. Bridges communication gaps, reveals hidden assumptions, and tests whether abstract ideas work in practice. Use when explaining concepts at different expertise levels, moving between abstract principles and concrete implementation, identifying edge cases by testing ideas against scenarios, designing layered documentation, decomposing complex problems into actionable steps, or bridging strategy-execution gaps.

Testing & QA25

Academic Letter Architect

200

lyndonkl/claude

Guides the creation of evidence-based academic recommendation letters, reference letters, and award nominations that combine concrete examples, meaningful comparisons, and genuine enthusiasm. Use when writing recommendation letters for students, postdocs, or colleagues, or when user mentions recommendation letter, reference, nomination, letter of support, endorsement, or needs help with strong advocacy and comparative statements.

Research & Science25

Adr Architecture

200

lyndonkl/claude

Documents significant architectural and technical decisions with full context, alternatives considered, trade-offs analyzed, and consequences understood. Creates a decision trail that helps teams understand why decisions were made. Use when choosing between technology options, making infrastructure decisions, establishing standards, migrating systems, or when user mentions ADR, architecture decision, technical decision record, or decision documentation.

Software Development25

Hello Skill Inline

117

Peiiii/skild

Minimal bundled skill (inline dependency) for testing skillsets.

Testing & QA10

Gamma

117

Peiiii/skild

Gamma sample skill for local discovery and CLI smoke tests.

Testing & QA10

Hello Skillset

117

Peiiii/skild

Example Skillset that bundles two minimal skills for testing.

Testing & QA10

Browse the most popular Claude skills, all testing & qa skills, or write your own with the skills generator.