Litellm Relay

LiteLLM Relay

LiteLLM Relay is a proxy you install on employee machines through your MDM. It does two things.

First, it sets up your developers' AI tools for them. On install, Relay auto-detects the AI tools already on the machine — Claude Desktop, Claude Code, and Codex (CLI, VS Code, and the macOS app) — and wires each one to your LiteLLM AI Gateway automatically. There is no per-tool opt-in: if Relay recognizes a tool, it routes it through the Gateway. Developers just launch the tool and sign in with their corporate identity, with no provider API key and no manual setup. See Auto-configuration and the AI Tool Guides below.

Second, it catches shadow AI. Relay detects AI traffic from tools like Notion AI, Perplexity, and OpenClaw and routes it to the Gateway too, making it a single pane of glass for all AI usage in your company.

Usage
 1. Install LiteLLM Relay on all your employee devices, using supported MDM
 2. Employees use AI tools as they normally would, such as Notion AI.

 3. Every request, response, and usage event is captured in LiteLLM.

Auto-configuration

Relay is opt-out, not opt-in. When you install it (or run relay setup), Relay
scans the device for supported AI tools and wires every one it finds to the
Gateway in a single pass — you never enumerate tools per machine.

Detection also runs on a schedule, so a tool installed *after* Relay gets wired
to the Gateway automatically — no manual re-run. Because each tool's config
lives in a different place, the installer registers two periodic jobs (both at
login and every RELAY_AUTOCONFIGURE_INTERVAL seconds, default 3600):

The root daemon runs a root-owned copy of the Relay binary at
/Library/PrivilegedHelperTools/ai.litellm.relay.autoconfigure-desktop, which
each install refreshes, and pins HOME to the…