Call Rlhf Self Reflection Scorer

Offline experimental post-call feedback scorer using supplied ratings and text heuristics. Use to demonstrate advisory review suggestions; no LLM inference, RLHF training, or memory integration is included.

116 stars 512 forksProductivity & Notes

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add CALLE-AI/awesome-phone-call-agents --skill call-rlhf-self-reflection-scorer
Manual install
git clone --depth 1 https://github.com/CALLE-AI/awesome-phone-call-agents.git /tmp/awesome-phone-call-agents
mkdir -p ~/.claude/skills
cp -r /tmp/awesome-phone-call-agents/skills/call-rlhf-self-reflection-scorer ~/.claude/skills/call-rlhf-self-reflection-scorer

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# RLHF Self-Reflection Scorer

This skill demonstrates post-call QA with a small lexical scorer. It accepts a supplied transcript and optional rating, then returns predefined review suggestions. It does not collect user feedback, call an LLM, train a model, store RAG memories, or apply prompt changes. These are possible future host integrations, not delivered behavior.

## Scientific Foundation

| Paper / Concept | Relevance |
|---|---|
| **LLM-as-a-Judge** | Using a strong LLM to evaluate the outputs of an agentic LLM correlates highly with human CSAT (Customer Satisfaction). |
| **Self-Reflection (Reflexion)** | Agents that critique their own past transcripts and generate "verbal reinforcement" prompts perform significantly better on subsequent tasks. |
| **RLHF (Reinforcement Learning from Human Feedback)** | Incorporating explicit user scores (if provided post-call) alongside automated critiques bridges the gap between simulated and real-world quality. |

## How it works

1. The skill receives the transcript and any explicit CSAT score given by the user (if applicable).
2. If the user gave a high score (>= 4), the interaction is marked as successful.
3. If the score is low or missing, the skill checks a small set of text patterns and returns a mocked critique; it cannot establish a root cause.
4. It outputs an `EvaluationResult` containing the score, the identified critique, and a specific system prompt recommendation to fix the behavior.

## Decision Matrix
Read the full skill on GitHub

Details

Skill name
call-rlhf-self-reflection-scorer
Path
skills/call-rlhf-self-reflection-scorer/SKILL.md
License
MIT
Repo updated
14 November 2026

FAQ

What does the Call Rlhf Self Reflection Scorer skill do?

Offline experimental post-call feedback scorer using supplied ratings and text heuristics. Use to demonstrate advisory review suggestions; no LLM inference, RLHF training, or memory integration is included.

How do I install the Call Rlhf Self Reflection Scorer skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add CALLE-AI/awesome-phone-call-agents --skill call-rlhf-self-reflection-scorer. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Call Rlhf Self Reflection Scorer popular?

It lives in CALLE-AI/awesome-phone-call-agents, which has 116 GitHub stars and 512 forks.

Related skills

Accesscall

116

CALLE-AI/awesome-phone-call-agents

Conduct phone-based accessibility intake interviews for users who cannot complete web-based accessibility audit forms (screen reader fatigue, motor impairment, low vision, cognitive load), and produce a structured result mapped to VPAT 2.4 / Section 508 conformance reporting fields.

Frontend & Design512

Accessible Outing Verifier

116

CALLE-AI/awesome-phone-call-agents

Demonstrates advisory accessibility-planning checks with offline fixtures and a proposed bounded CALL-E workflow; use for exploring unknown or qualified venue claims without making calls.

Frontend & Design512

Adherence Memory Callback

116

CALLE-AI/awesome-phone-call-agents

Run a consent-based outbound CALL-E medication-adherence phone check-in that remembers each caller across calls, learns side-effect patterns across many callers behind a corroboration gate, and honors "call me back later" by opening the next call with that context.

Productivity & Notes512

Call State Reconciler

116

CALLE-AI/awesome-phone-call-agents

Work out what actually happened to a CALL-E call by reading the call task, its attempts and its event stream together, and say which field each conclusion came from. Use when a workflow acts on a call result, when a call will not settle, or when the platform's own signals disagree with each other.

Productivity & Notes512

Call Reminder

116

CALLE-AI/awesome-phone-call-agents

Schedule recurring CALL-E phone-call reminders, scheduled CALL-E calls, call-me-at-a-time requests, and remind-me-by-phone workflows by wrapping the existing one-off CALL-E call workflow in the current client's scheduler or automation system.

Productivity & Notes512

Calle Script Advisor

116

CALLE-AI/awesome-phone-call-agents

Draft and check CALL-E phone-call task text and result schemas for clarity, safety, and extraction quality before any call is placed.

Productivity & Notes512

Browse the most popular Claude skills, all productivity & notes skills, or write your own with the skills generator.