Modelwatch MCP Server: Install & Setup

Install Modelwatch in Claude Code

Claude Code

claude mcp add modelwatch -e MODELWATCH_API_KEY=... -- npx -y modelwatch-mcp

mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)

{
  "mcpServers": {
    "modelwatch": {
      "command": "npx",
      "args": [
        "-y",
        "modelwatch-mcp"
      ],
      "env": {
        "MODELWATCH_API_KEY": "..."
      }
    }
  }
}

Replace each ... with your own value.

Frequently asked questions

What does the Modelwatch MCP server do?

Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.

Is the Modelwatch MCP server free?

The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.

Does Modelwatch run locally or remotely?

Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.

How do I add Modelwatch to Claude Code?

Run: claude mcp add modelwatch -e MODELWATCH_API_KEY=... -- npx -y modelwatch-mcp

More monitoring & observability MCP servers

View all

Openobserve Community

alilxxey/openobserve-community-mcp

Read-only access to OpenObserve Community Edition: search logs, traces, stream schemas and dashboards without an Enterprise license.

LocalFreePython

Model Ledger

block/model-ledger

Model inventory and governance: trace deployed models and their dependencies as an append-only log

LocalFree

Exit1 Uptime Monitoring

0466

Mopra/exit1.dev.mcp

Set up uptime monitoring from your editor: create checks, alerts, and query uptime. Can sign you up.

Local + RemoteFree

Infra Lens

2457

oaslananka/infra-lens-mcp

SSH Linux metrics, baselines, anomaly detection, and plain-English infrastructure explanations.

LocalFree

VMware Monitor

vmware-skills/VMware-Monitor

Read-only VMware vCenter/ESXi monitoring, 33 MCP tools; vSphere calls allowlist-gated in tests.

LocalFree

Incident Timeline

0517

mrfentmen/incident-timeline-mcp

Summarize local log timeline gaps and severity counts without returning messages, IDs, paths, or...

LocalFree