Nvidia Nim MCP Server: Install & Setup

Install Nvidia Nim in Claude Code

Claude Code

claude mcp add nvidia-nim -e NVIDIA_API_KEY=... -- npx -y nvidia-nim-mcp

mcp.json (Claude Desktop, Cursor, VS Code, Windsurf)

{
  "mcpServers": {
    "nvidia-nim": {
      "command": "npx",
      "args": [
        "-y",
        "nvidia-nim-mcp"
      ],
      "env": {
        "NVIDIA_API_KEY": "..."
      }
    }
  }
}

Replace each ... with your own value.

Frequently asked questions

What does the Nvidia Nim MCP server do?

MCP server for NVIDIA NIM - 50+ LLMs, multimodal, image gen, embeddings, reranking

Is the Nvidia Nim MCP server free?

The server is free, but you will likely need an account. The server itself is free, but it connects to a service that needs an account or API key, which may have paid tiers. Check the provider for current pricing.

Does Nvidia Nim run locally or remotely?

Local. Runs on your machine (stdio). You install it with npx, uvx, Docker or from source.

How do I add Nvidia Nim to Claude Code?

Run: claude mcp add nvidia-nim -e NVIDIA_API_KEY=... -- npx -y nvidia-nim-mcp

More knowledge, memory & rag MCP servers

View all

Agentset

agentset-ai/mcp-server

RAG MCP for your Agentset data.

LocalFree

AgentRecall

922

Goldentrii/AgentRecall-MCP

Correction-first agent memory. Precision KPI tracks if agents heed warnings. 5 layers, local-only.

LocalFree

Vectara

vectara/vectara-mcp

Access Vectara's RAG-as-a-service platform.

LocalAccount neededPython

Data Olympus

knaisoma/data-olympus

Git-native Markdown knowledge base for coding agents with proposed vs. accepted guidance, validity windows, supersession chains and status-aware retrieval.

LocalFreePython

Agentdocs

1869

hoornet/agentdocs-mcp

Read, create, update, comment on and share AgentDocs Markdown docs, with full-text and semantic search.

Local + RemoteAccount neededTypeScript

Context Provider

doobidoo/MCP-Context-Provider

Static server providing persistent tool-specific context and rules to AI models.

LocalFreeTypeScript