Hyperloom Workload Optimizer
Autonomously optimizes end-to-end LLM inference throughput on AMD Instinct GPUs and reports a validated gain, using the Hyperloom multi-agent optimizer. Given a model, framework, workload (TP/EP, concurrency, ISL/OSL, precision), an objective and a time budget, it explores per-workload which levers to pull (serving/config parameters and env, framework enablement and source patches, and hot GPU-kernel rewrites), benchmarks each candidate, and returns the optimization stack that produced the gain. Use when the user wants to make a model serve faster, raise tokens/sec or throughput, optimize or t
Install
/plugin marketplace add amd/skillsThe repo is a Claude Code plugin marketplace. Run /plugin afterwards to pick the plugin that includes this skill.
npx skills add amd/skills --skill hyperloom-workload-optimizergit clone --depth 1 https://github.com/amd/skills.git /tmp/skills
mkdir -p ~/.claude/skills
cp -r /tmp/skills/skills/hyperloom-workload-optimizer ~/.claude/skills/hyperloom-workload-optimizerPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Hyperloom Workload Optimizer You are the entry point for Hyperloom optimization on AMD Instinct GPUs. Your job is the bootstrap: confirm the workspace, install the Hyperloom wheel, run `/hyperloom-setup`, then hand the run to the skill that owns it. The wheel installs the skills that own everything after setup: `hyperloom-setup` for credentials and run mode, the demo skills for a workload preset, and `inference_optimizer` for the launcher gates and monitoring. They ship with the runtime, so they always match the installed version. ## Out of scope for this skill - Do not run `python -m hyperloom.inference_optimizer.cli optimize` yourself. - Do not implement a GPU preflight, launcher gate, or background launch here. The installed skills own those, including the Iron Rules and the resume path. - Do not ask for workload values (model, TP/EP, concurrency, ISL/OSL, precision, objective, budget) while installing or while setup is running. They belong to the run skill, after setup finishes. - Do not optimize by hand in chat. ## Prerequisites - AMD Instinct GPU host (MI300X / MI325X / MI355X) with ROCm, `/dev/kfd` and `/dev/dri` present, and `amd-smi` or `rocm-smi` working. - Python 3.10+ and `pip` on the machine that runs the install. - LLM credentials: Anthropic API access, or the AMD LLM gateway. - A dedicated empty directory, opened in the agent as the workspace. Confirm the shell you are in is on the GPU host before installing. Setup may later
Details
- Skill name
hyperloom-workload-optimizer- Repository
- amd/skills
- Path
skills/hyperloom-workload-optimizer/SKILL.md- License
- MIT
- Repo updated
- 18 November 2026
FAQ
What does the Hyperloom Workload Optimizer skill do?
Autonomously optimizes end-to-end LLM inference throughput on AMD Instinct GPUs and reports a validated gain, using the Hyperloom multi-agent optimizer. Given a model, framework, workload (TP/EP, concurrency, ISL/OSL, precision), an objective and a time budget, it explores per-workload which levers to pull (serving/config parameters and env, framework enablement and source patches, and hot GPU-kernel rewrites), benchmarks each candidate, and returns the optimization stack that produced the gain. Use when the user wants to make a model serve faster, raise tokens/sec or throughput, optimize or t
How do I install the Hyperloom Workload Optimizer skill?
Claude Code plugin: /plugin marketplace add amd/skills. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Hyperloom Workload Optimizer popular?
It lives in amd/skills, which has 500 GitHub stars and 47 forks.
Related skills
Apu Memory Tuner
500amd/skills
Inspects and tunes the shared-vs-dedicated memory split on AMD Ryzen APUs with unified memory (UMA) so larger LLMs and image-gen models fit on the iGPU, or so reserved GPU memory is returned to the CPU. Use when the user mentions Ryzen AI, Strix Halo / Strix Point / Krackan / Phoenix / Hawk Point, Ryzen AI Max, gfx1150 / gfx1151 / gfx1152, integrated Radeon, iGPU memory, UMA Frame Buffer Size, AMD Variable Graphics Memory, VGM, GTT, GART, TTM, pages_limit, amd-ttm, amd-debug-tools, "shared GPU memory", "dedicated GPU memory", carve-out, "not enough VRAM", "out of VRAM", "GPU OOM", llama.cpp on
Eaiapps Guided Install
500amd/skills
Guides a user through installing the AI Workbench (AIWB) onto a Kubernetes cluster end-to-end — preflight cluster readiness (access, StorageClass, GPU operator, required operators/CRDs), install the Helm charts in the correct order, and verify the deployment is healthy with plain-language failure triage. Use when a user wants to install, deploy, or stand up AIWB / the AI Workbench / the enterprise AI stack on a K8s cluster, or asks why their install failed partway. Use PROACTIVELY when a user is following helm/INSTALL.md by hand. Do NOT activate for onboarding models to AIM, general kubectl/he
Flydsl Kernel Authoring
500amd/skills
Comprehensive reference for authoring FlyDSL GPU kernels on AMD GPUs. Covers the layout algebra, tiled copy/MMA, buffer ops, loop-carried range loops, SharedAllocator (LDS), autotuning, and common patterns. Use when writing, reviewing, or understanding FlyDSL kernel code.
Lemonade Router Builder
500amd/skills
Turns a natural-language description of routing intent into a valid Lemonade `collection.router` policy JSON. The skill generates and validates the JSON only - it does not register it or call the live server. Use when the user wants to route requests between models ("route sensitive queries to X and everything else to Y"), generate a router/hybrid-router config or policy, author a collection.router JSON, split traffic between a small local model and a big/cloud model, add PII/jailbreak/topic classifiers to routing, route on a yes/no or graded question about the prompt using a decision model, o
Ielts
346YANZHANLIN/ielts-claude-skills
雅思备考 AI 教练系统入口。路由到写作 / 阅读 / 口语训练。 触发方式:/ielts、「我要备考雅思」「雅思怎么准备」「IELTS」
Local AI App Integration
500amd/skills
Integrates local AI capabilities into applications using Embeddable Lemonade. Use when the user wants to add local AI, offline AI, private AI, on-device AI, a local LLM, local chat, embeddings, image generation, speech-to-text, or text-to-speech to an existing app; replace or supplement OpenAI, Anthropic, Ollama, or other cloud AI APIs with a local backend; only use to convert user apps. Do not use when the user just wants the agent itself to generate images, transcribe, or speak locally in the current workspace, even to cut their own API bill.
Browse the most popular Claude skills, all ai, llms & agents skills, or write your own with the skills generator.