Call Agent Certainty Calibrator

Offline experimental CALL-E transcript helper that flags agent statements of specific values absent from the goal facts and callee turns (over-assertion) and goal facts spoken with hedges but no source attribution (over-hedging), plus a three-tier calibrated-wording goal template. It is not proof the agent invented anything, a measure of internal confidence, or authorization to act.

116 stars 512 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add CALLE-AI/awesome-phone-call-agents --skill call-agent-certainty-calibrator
Manual install
git clone --depth 1 https://github.com/CALLE-AI/awesome-phone-call-agents.git /tmp/awesome-phone-call-agents
mkdir -p ~/.claude/skills
cp -r /tmp/awesome-phone-call-agents/skills/call-agent-certainty-calibrator ~/.claude/skills/call-agent-certainty-calibrator

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# call-agent-certainty-calibrator

> **An agent that invents specifics is worse than one that says 'I don't
> know'. An agent that hedges its own record is worse than useless.**

Language models can express calibrated confidence in words - and, left
unchecked, they drift both ways: asserting specifics nobody gave them
("free delivery on Friday!") and softening facts they were told to state
("I think it might be $45?"). On a phone call both failures are audible,
and both end up in the outcome. This skill grades the agent's stated
values against the goal it was given.

## When To Use

- after any fact-bearing CALL-E call, together with the goal text (or
  plan JSON) the call was built from
- when an outcome contains a value nobody remembers putting in the goal
- before placing calls, to craft wording that speaks record facts with
  authority and admits gaps honestly

## When Not To Use

- without the goal file; calibration is graded against the goal's facts
  and the CLI requires it
- to prove the agent fabricated a value; an OVER-ASSERTED value may be
  true and simply missing from the goal text - the card routes to
  verification, always
- on the callee's certainty; `provenance-grade` grades how the callee
  knew what they said
- during a call; strictly post-call analysis plus pre-call goal crafting

## Workflow

### Audit a finished call

```bash
python3 scripts/agent_certainty_calibrator.py analyze \
  --transcript path/to/call-result.json --goal-file path/to/goal.txt
```
Read the full skill on GitHub

Details

Skill name
call-agent-certainty-calibrator
Path
skills/call-agent-certainty-calibrator/SKILL.md
License
MIT
Repo updated
14 November 2026

FAQ

What does the Call Agent Certainty Calibrator skill do?

Offline experimental CALL-E transcript helper that flags agent statements of specific values absent from the goal facts and callee turns (over-assertion) and goal facts spoken with hedges but no source attribution (over-hedging), plus a three-tier calibrated-wording goal template. It is not proof the agent invented anything, a measure of internal confidence, or authorization to act.

How do I install the Call Agent Certainty Calibrator skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add CALLE-AI/awesome-phone-call-agents --skill call-agent-certainty-calibrator. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Call Agent Certainty Calibrator popular?

It lives in CALLE-AI/awesome-phone-call-agents, which has 116 GitHub stars and 512 forks.

Related skills

Accesscall

116

CALLE-AI/awesome-phone-call-agents

Conduct phone-based accessibility intake interviews for users who cannot complete web-based accessibility audit forms (screen reader fatigue, motor impairment, low vision, cognitive load), and produce a structured result mapped to VPAT 2.4 / Section 508 conformance reporting fields.

Frontend & Design512

Accessible Outing Verifier

116

CALLE-AI/awesome-phone-call-agents

Demonstrates advisory accessibility-planning checks with offline fixtures and a proposed bounded CALL-E workflow; use for exploring unknown or qualified venue claims without making calls.

Frontend & Design512

Adherence Memory Callback

116

CALLE-AI/awesome-phone-call-agents

Run a consent-based outbound CALL-E medication-adherence phone check-in that remembers each caller across calls, learns side-effect patterns across many callers behind a corroboration gate, and honors "call me back later" by opening the next call with that context.

Productivity & Notes512

Call Agent Commitment Tracker

116

CALLE-AI/awesome-phone-call-agents

Offline heuristic CALL-E phone call transcript skill that extracts and classifies agent Commissive Speech Acts — promises, follow-up pledges, and delegation statements — into WITH_DEADLINE, WITHOUT_DEADLINE, and CONDITIONAL buckets, then emits a verification follow-up call goal. It is not proof a commitment was broken, a legal analysis, or authorization to act automatically.

AI, LLMs & Agents512

Bridgecalle Active Listener

116

CALLE-AI/awesome-phone-call-agents

Prompt-guided active-listening phone check-in companion skill for seniors that uses CALL-E outbound phone calls to provide gentle verbal nods, extract nostalgic memories, and export family summaries.

AI, LLMs & Agents512

Call AI Disclosure Comprehension Auditor

116

CALLE-AI/awesome-phone-call-agents

Offline experimental CALL-E transcript helper that grades whether the agent disclosed being an AI, whether the disclosure came before business content, whether a comprehension question was asked, and whether an acknowledgment was captured, plus a disclosure-first goal template. It is not legal advice, jurisdiction-specific compliance certification, or proof the person did or did not understand.

AI, LLMs & Agents512

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.