Cxas Sim Eval

Converts CXAS golden evaluations to SCRAPI SimulationEvals test cases. Use when generating high-level, goal-oriented test cases from turn-by-turn evaluation JSONs, and when enriching test expectations with inferred tool calls.

117 stars 117 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add GoogleCloudPlatform/cxas-scrapi --skill cxas-sim-eval
Manual install
git clone --depth 1 https://github.com/GoogleCloudPlatform/cxas-scrapi.git /tmp/cxas-scrapi
mkdir -p ~/.claude/skills
cp -r /tmp/cxas-scrapi/.agents/skills/cxas-sim-eval ~/.claude/skills/cxas-sim-eval

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# CXAS Evaluation to Simulation Converter

This skill helps convert turn-by-turn CXAS golden evaluations into high-level, goal-oriented test cases for the SCRAPI `SimulationEvals` framework. It analyzes the agent's tools to enrich expectations with specific tool calls.

______________________________________________________________________

## Steps

### 1. Check Environment

Ensure `cxas_scrapi` is installed as a python package. You can check this by running:

```bash
python -c "import cxas_scrapi"
```

Ensure `gcloud` is authenticated properly:

```bash
gcloud auth list
```

If needed, login with:

```bash
gcloud auth login
```

### 2. Get App Name and Output Directory

> [!IMPORTANT]
> You MUST ask the user for the full resource name of the app/agent (e.g., `projects/.../locations/.../apps/...`) and the base output directory before proceeding with any execution steps.

Ask the user for these values.

### 3. Fetch Evaluations

Fetch the list of evaluations using the CES API. Save each evaluation as a JSON file named after its display name under `[output_dir]/golden_evals/`.

### 4. Fetch Tool Schemas

Fetch the full schemas for all tools available in the app and save them under `[output_dir]/tools/`.

### 5. Fetch Agent Tools Configuration

Fetch the list of tools and toolsets used by the agent and save the configuration (e.g., to `[output_dir]/agent_tools.json`).

### 6. Convert Evaluations
Read the full skill on GitHub

Details

Skill name
cxas-sim-eval
Path
.agents/skills/cxas-sim-eval/SKILL.md
License
Apache-2.0
Repo updated
17 November 2026

FAQ

What does the Cxas Sim Eval skill do?

Converts CXAS golden evaluations to SCRAPI SimulationEvals test cases. Use when generating high-level, goal-oriented test cases from turn-by-turn evaluation JSONs, and when enriching test expectations with inferred tool calls.

How do I install the Cxas Sim Eval skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add GoogleCloudPlatform/cxas-scrapi --skill cxas-sim-eval. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Cxas Sim Eval popular?

It lives in GoogleCloudPlatform/cxas-scrapi, which has 117 GitHub stars and 117 forks.

Related skills

Adk Framework Ingestor

117

GoogleCloudPlatform/cxas-scrapi

Parsing and ingestion directives for the Python-based Agent Development Kit (ADK) conversational agent framework.

Software Development117

Cxas Agent Foundry

117

GoogleCloudPlatform/cxas-scrapi

End-to-end GECX/CXAS/CES conversational agent lifecycle -- build agents from requirements (PRD-to-agent), create and run evals (goldens, simulations, tool tests, callback tests), debug failures, and iterate to production quality. Use this skill whenever the user mentions GECX, CXAS, CES, SCRAPI, conversational agents, voice agents, audio agents, agent evals, pushing/pulling/linting agents, or agent instructions/callbacks/tools on the Google Customer Engagement Suite platform.

AI, LLMs & Agents117

Cxas Autolabel Rules

117

GoogleCloudPlatform/cxas-scrapi

Author, validate, and manage Contact Center AI (CCAI) Insights Autolabeling Rules. Use when users want to translate business labeling logic into CEL condition expressions, maintain declarative autolabel_rules.yaml configurations, or synchronize rules to GCP projects.

DevOps & Cloud117

Doc Sync Tool

193

MavCui/Agent-Skills-Hunter

自动同步项目中的 Agents.md、claude.md 和 gemini.md 文件,保持内容一致性。支持自动监听和手动触发。

AI, LLMs & Agents28

Cxas Self Steering Agent

117

GoogleCloudPlatform/cxas-scrapi

Builds and refactors self-steering CXAS (CES, GECX) conversational agents for chat or voice, where the model runs the whole conversation like a contact center agent: one root agent, Jinja progressive disclosure (playbooks and tasks loaded through open_playbook and load_task, dynamic tool hiding) and deterministic actions (greeting, verbatim text, goodbye and live agent handoff through set_next_agent_actions). Ships a working sample agent to start from. Use when creating a new CXAS agent, adding playbooks, tasks or tools to an agent built this way, replacing a steering agent with sub-agents or

AI, LLMs & Agents117

Checkup

91

agentvitals/checkup

Give your AI agent a professional health checkup (AgentVitals). Use when the user asks the agent to run a checkup / test itself / benchmark itself ("run a checkup", "check your vitals", "test yourself", "how stable are you", "/checkup"), or an advanced personality checkup (backbone, proactivity, creativity). 给 AI agent 做一次专业体检(AgentVitals · AI体检)。当用户说"做个体检 / 测测你自己 / checkup / 看看你多稳 / 测福祉 / 测骨气"时使用。

AI, LLMs & AgentsIn 1 list

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.