Serving Llms Vllm
vLLM: high-throughput LLM serving, OpenAI API, quantization.
Install
npx skills add Lord1Egypt/RA-Skills --skill serving-llms-vllmgit clone --depth 1 https://github.com/Lord1Egypt/RA-Skills.git /tmp/RA-Skills
mkdir -p ~/.claude/skills
cp -r /tmp/RA-Skills/skills/built-in/mlops/inference/vllm ~/.claude/skills/serving-llms-vllmPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# vLLM - High-Performance LLM Serving
## When to use
Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
## Quick start
vLLM achieves 24x higher throughput than standard transformers through PagedAttention (block-based KV cache) and continuous batching (mixing prefill/decode requests).
**Installation**:
```bash
pip install vllm
```
**Basic offline inference**:
```python
from vllm import LLM, SamplingParams
llm = LLM(model="meta-llama/Llama-3-8B-Instruct")
sampling = SamplingParams(temperature=0.7, max_tokens=256)
outputs = llm.generate(["Explain quantum computing"], sampling)
print(outputs[0].outputs[0].text)
```
**OpenAI-compatible server**:
```bash
vllm serve meta-llama/Llama-3-8B-Instruct
# Query with OpenAI SDK
python -c "
from openai import OpenAI
client = OpenAI(base_url='http://localhost:8000/v1', api_key='EMPTY')
print(client.chat.completions.create(
model='meta-llama/Llama-3-8B-Instruct',
messages=[{'role': 'user', 'content': 'Hello!'}]
).choices[0].message.content)
"
```
## Common workflows
### Workflow 1: Production API deployment
Copy this checklist and track progress:
```
Deployment Progress:
- [ ] Step 1: Configure server settings
- [ ] Step 2: Test with limited traffic
- [ ] Step 3: Enable monitoring
- [ ] Step 4: Deploy to production
- [ ] Step 5: Verify performance metrics
```Details
- Skill name
serving-llms-vllm- Repository
- Lord1Egypt/RA-Skills
- Path
skills/built-in/mlops/inference/vllm/SKILL.md- Repo updated
- 17 November 2026
FAQ
What does the Serving Llms Vllm skill do?
vLLM: high-throughput LLM serving, OpenAI API, quantization.
How do I install the Serving Llms Vllm skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add Lord1Egypt/RA-Skills --skill serving-llms-vllm. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Serving Llms Vllm popular?
It lives in Lord1Egypt/RA-Skills, which has 9 GitHub stars and 2 forks.
Related skills
Account Management
9Lord1Egypt/RA-Skills
Reach the Plug&Pay Customer Portal (portal.plugandpay.com/login/{merchant-slug}) where a customer manages their account: view subscriptions, download invoices, edit billing details, change payment term, and cancel/resume a subscription. Documents the passwordless magic-link lo…
Add Items to Cart
9Lord1Egypt/RA-Skills
Resolve a free-text grocery list to specific King Soopers products (UPC, brand, size, price), ask follow-up questions for ambiguous items, then add the confirmed products to the signed-in user's cart for pickup or delivery.
Add to Cart
9Lord1Egypt/RA-Skills
Find a product on kmart.com.au by natural-language query, navigate to the product detail page, capture title/price/SKU/availability, and drive the read-only pre-checkout flow up to the bag (/checkout/bag). Never submits an order — stops at the bag review screen. Documents the …
Sf Court Booking
9Lord1Egypt/RA-Skills
Reserve a tennis or pickleball court in the San Francisco Recreation & Park system via rec.us. Prompts for activity, date, and time window; logs in; selects the first available reservable slot in the window; confirms the booking; returns the confirmation code.
Segment Anything Model
9Lord1Egypt/RA-Skills
SAM: zero-shot image segmentation via points, boxes, masks.
Touchdesigner MCP
9Lord1Egypt/RA-Skills
Control a running TouchDesigner instance via twozero MCP — create operators, set parameters, wire connections, execute Python, build real-time visuals. 36 native tools.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.