Sim Use
Drive iOS Simulator and Android emulator/device screens for AI agents. Use when asked to automate a simulator or emulator, tap/swipe/type on a device, describe UI, take a screenshot, or interact with a mobile app.
Install
npx skills add cafe3310/public-agent-skills --skill sim-usegit clone --depth 1 https://github.com/cafe3310/public-agent-skills.git /tmp/public-agent-skills
mkdir -p ~/.claude/skills
cp -r /tmp/public-agent-skills/skills_parked/sim-use ~/.claude/skills/sim-usePersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
## 0. Preflight Before first interaction with a device, run the preflight check: ```bash python3 scripts/preflight.py --device <UDID> ``` This verifies sim-use is installed, the device is reachable, and the daemon is healthy. If you don't have the script, do the checks manually: 1. `sim-use --version` — confirm sim-use is on PATH. 2. `sim-use devices` — confirm the target device is listed and booted/connected. 3. `sim-use ui --device <UDID>` — confirm you can read the screen. `--device` is optional when only one simulator is booted or one daemon is running. For Android, run `sim-use android init --device <serial>` once to install the bridge APK. ## 1. The observe-act loop Every interaction follows the same cycle: **observe → act → verify**. ### Observe ```bash sim-use ui --device <UDID> ``` Read the outline. Each element has an `@N` alias and optionally a `#<id>` identifier. List cells carry `#N` (dominant list) or `#N@M` (scoped). Frames in the JSON output (`--json`: `entries[].frame`, `screen`) are in platform-native units — iOS **points**, Android **pixels**. Key off the envelope's `platform` field before doing math on coordinates across platforms. ### Act Pick a selector, in order of preference: | Selector | When to use | |---|---| | `tap @N` | Right after `ui`. Fastest, cache-backed. | | `tap #<id>` | Stable across minor layout changes. Paste from the outline. | | `tap --label 'X'` | Scripted flows. Combine with `--wait-timeout` for transitions. |
Details
- Skill name
sim-use- Repository
- cafe3310/public-agent-skills
- Path
skills_parked/sim-use/SKILL.md- License
- Apache-2.0
- Repo updated
- 15 November 2026
FAQ
What does the Sim Use skill do?
Drive iOS Simulator and Android emulator/device screens for AI agents. Use when asked to automate a simulator or emulator, tap/swipe/type on a device, describe UI, take a screenshot, or interact with a mobile app.
How do I install the Sim Use skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add cafe3310/public-agent-skills --skill sim-use. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Sim Use popular?
It lives in cafe3310/public-agent-skills, which has 260 GitHub stars and 30 forks.
Related skills
Skill Creator
260cafe3310/public-agent-skills
Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.
Impeccable
260cafe3310/public-agent-skills
Use when the user wants to design, redesign, shape, critique, audit, polish, clarify, distill, harden, optimize, adapt, animate, colorize, extract, or otherwise improve a frontend interface. Not for backend-only or non-UI tasks.
Agent Browser
260cafe3310/public-agent-skills
为 Agent 设计的自动化浏览器 CLI 工具,也能操作 Electron 桌面应用。当需要与网站交互(包括页面导航)时使用
Flutter API
192smallnest/goskills
Comprehensive Flutter API reference guide covering widgets, Material Design, Cupertino, animations, gestures, navigation, state management, and platform integration. Use when developing Flutter applications and needing detailed API knowledge for widgets, layout, styling, animations, platform channels, or any Flutter SDK functionality. Essential for building cross-platform mobile, web, and desktop applications with Flutter.
Stacktrace Log Triage
398JetBrains/skills
Diagnose Kotlin + Spring failures from stack traces, startup logs, runtime logs, and related metric anomalies, then separate root cause from wrapper exceptions and propose safe next steps. Use when the application fails to start, an endpoint crashes, logs are noisy or deeply nested, or the agent must produce both a quick mitigation and a proper long-term fix without guessing.
Native App Designer
272curiositech/some_claude_skills
Creates breathtaking iOS/Mac and web apps with organic, non-AI aesthetic. Expert in SwiftUI, React animations, physics-based motion, and human-crafted design. Use for iOS/Mac app UI, React/Vue animations, native-feel web apps, physics-based motion design. Activate on "SwiftUI", "iOS app", "native app", "React animation", "motion design", "UIKit", "physics animation". NOT for backend logic, API design (use backend-architect), simple static sites (use web-design-expert), or pure graphic design (use design-system-creator).
Browse the most popular Claude skills, all mobile development skills, or write your own with the skills generator.