Llmtest MCP Server: Install & Setup

Install Llmtest in Claude Code

Claude Code

claude mcp add llmtest -e LLMTEST_API_KEY=... -- npx -y llmtest-mcp

mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)

{
  "mcpServers": {
    "llmtest": {
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp"
      ],
      "env": {
        "LLMTEST_API_KEY": "..."
      }
    }
  }
}

Replace each ... with your own value.

Frequently asked questions

What does the Llmtest MCP server do?

Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.

Is the Llmtest MCP server free?

The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.

Does Llmtest run locally or remotely?

Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.

How do I add Llmtest to Claude Code?

Run: claude mcp add llmtest -e LLMTEST_API_KEY=... -- npx -y llmtest-mcp

More ai agents & coding agents MCP servers

View all

looktap

lakpriya1s/looktap

Let your AI agent see, use and control the apps on your phone: screen as text, tap by label.

LocalFree

Kosha Model Discovery

sriinnu/kosha-discovery

Tells your agent which model to use and what it costs, across 46 providers and local runtimes.

LocalFree

Meta Prompt

kapillamba4/meta-prompt-mcp

MCP server providing official Google and Anthropic prompting guides for meta-prompt generation.

LocalFree

KiCad Schematics

unmateria/MCP-Kicad

Design KiCad schematics by talking to Claude. Places parts, wires nets, runs ERC. Needs KiCad 10.

LocalFree

Model Salt

modelsalt/model-salt

Randomness from outside the model, so one prompt gives different answers that still fit the ask.

LocalFree

Hesperan

101

com.hesperan/mcp

Calibrated decisions for agents: choice, yes/no and score questions answered with probabilities.

Local + RemoteAccount needed