Serving Llms Vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

9 stars 2 forksAI, LLMs & Agents

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add Lord1Egypt/RA-Skills --skill serving-llms-vllm
Manual install
git clone --depth 1 https://github.com/Lord1Egypt/RA-Skills.git /tmp/RA-Skills
mkdir -p ~/.claude/skills
cp -r /tmp/RA-Skills/skills/built-in/mlops/inference/vllm ~/.claude/skills/serving-llms-vllm

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# vLLM - High-Performance LLM Serving

## When to use

Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

## Quick start

vLLM achieves 24x higher throughput than standard transformers through PagedAttention (block-based KV cache) and continuous batching (mixing prefill/decode requests).

**Installation**:
```bash
pip install vllm
```

**Basic offline inference**:
```python
from vllm import LLM, SamplingParams

llm = LLM(model="meta-llama/Llama-3-8B-Instruct")
sampling = SamplingParams(temperature=0.7, max_tokens=256)

outputs = llm.generate(["Explain quantum computing"], sampling)
print(outputs[0].outputs[0].text)
```

**OpenAI-compatible server**:
```bash
vllm serve meta-llama/Llama-3-8B-Instruct

# Query with OpenAI SDK
python -c "
from openai import OpenAI
client = OpenAI(base_url='http://localhost:8000/v1', api_key='EMPTY')
print(client.chat.completions.create(
    model='meta-llama/Llama-3-8B-Instruct',
    messages=[{'role': 'user', 'content': 'Hello!'}]
).choices[0].message.content)
"
```

## Common workflows

### Workflow 1: Production API deployment

Copy this checklist and track progress:

```
Deployment Progress:
- [ ] Step 1: Configure server settings
- [ ] Step 2: Test with limited traffic
- [ ] Step 3: Enable monitoring
- [ ] Step 4: Deploy to production
- [ ] Step 5: Verify performance metrics
```
Read the full skill on GitHub

Details

Skill name
serving-llms-vllm
Path
skills/built-in/mlops/inference/vllm/SKILL.md
Repo updated
17 November 2026

FAQ

What does the Serving Llms Vllm skill do?

vLLM: high-throughput LLM serving, OpenAI API, quantization.

How do I install the Serving Llms Vllm skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add Lord1Egypt/RA-Skills --skill serving-llms-vllm. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Serving Llms Vllm popular?

It lives in Lord1Egypt/RA-Skills, which has 9 GitHub stars and 2 forks.

Related skills

Account Management

9

Lord1Egypt/RA-Skills

Reach the Plug&Pay Customer Portal (portal.plugandpay.com/login/{merchant-slug}) where a customer manages their account: view subscriptions, download invoices, edit billing details, change payment term, and cancel/resume a subscription. Documents the passwordless magic-link lo…

Documents & Office Files

Add Items to Cart

9

Lord1Egypt/RA-Skills

Resolve a free-text grocery list to specific King Soopers products (UPC, brand, size, price), ask follow-up questions for ambiguous items, then add the confirmed products to the signed-in user's cart for pickup or delivery.

Frontend & Design

Add to Cart

9

Lord1Egypt/RA-Skills

Find a product on kmart.com.au by natural-language query, navigate to the product detail page, capture title/price/SKU/availability, and drive the read-only pre-checkout flow up to the bag (/checkout/bag). Never submits an order — stops at the bag review screen. Documents the …

Other

Sf Court Booking

9

Lord1Egypt/RA-Skills

Reserve a tennis or pickleball court in the San Francisco Recreation & Park system via rec.us. Prompts for activity, date, and time window; logs in; selects the first available reservable slot in the window; confirms the booking; returns the confirmation code.

AI, LLMs & Agents

Segment Anything Model

9

Lord1Egypt/RA-Skills

SAM: zero-shot image segmentation via points, boxes, masks.

AI, LLMs & Agents

Touchdesigner MCP

9

Lord1Egypt/RA-Skills

Control a running TouchDesigner instance via twozero MCP — create operators, set parameters, wire connections, execute Python, build real-time visuals. 36 native tools.

AI, LLMs & Agents

Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.