Audio Reactive Video Composition
Provider-independent production guidance for translating measured audio features into deterministic video timing and motion. Use for beat-, onset-, phrase-, energy-, silence-, or spectrum-reactive visualizers, edits, typography, and generated compositions; not for music-video concept direction, audio generation, or a runtime-specific recipe.
Install
npx skills add calesthio/generative-media-skills --skill audio-reactive-video-compositiongit clone --depth 1 https://github.com/calesthio/generative-media-skills.git /tmp/generative-media-skills
mkdir -p ~/.claude/skills
cp -r /tmp/generative-media-skills/skills/production/runtime-assembly/audio-reactive-video-composition ~/.claude/skills/audio-reactive-video-compositionPersonal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.
From the SKILL.md
# Audio-reactive video composition
Use this skill to turn an approved audio source into an auditable cue map and then into bounded visual behavior. The central contract is:
$$
\text{source audio} \rightarrow \text{measured features} \rightarrow
\text{confidence-bearing cues} \rightarrow \text{reviewed anchors} \rightarrow
\text{deterministic visual timeline}
$$
Do not equate a detector output with editorial meaning. An onset is not automatically a beat, cut, drop, or lyric accent; an acoustic cluster is not automatically a verse or chorus.
## Evidence stance
- **Documented fact:** behavior stated by official analysis libraries, standards, or cited research.
- **Production heuristic:** a practical mapping that must be tested on the track and audience.
- **Empirical observation:** a measured result from the supplied audio, analyzer run, render, or playback.
Analysis algorithms, defaults, and model behavior are volatile. Facts were verified **2026-07-12**. Pin the decoder, library, model, parameters, and random seeds used for each production.
## Scope
This skill owns source custody, analysis policy, confidence interpretation, rhythmic/non-rhythmic routing, cue promotion, feature-to-visual mappings, rational frame alignment, accessibility, and render QA.
It does not own music-video narrative or artist branding, music generation, mastering, source separation, transcription, lyric writing, or a HyperFrames/Remotion/FFmpeg-specific implementation.Details
- Skill name
audio-reactive-video-composition- Repository
- calesthio/generative-media-skills
- Path
skills/production/runtime-assembly/audio-reactive-video-composition/SKILL.md- License
- MIT
- Repo updated
- 14 July 2026
FAQ
What does the Audio Reactive Video Composition skill do?
Provider-independent production guidance for translating measured audio features into deterministic video timing and motion. Use for beat-, onset-, phrase-, energy-, silence-, or spectrum-reactive visualizers, edits, typography, and generated compositions; not for music-video concept direction, audio generation, or a runtime-specific recipe.
How do I install the Audio Reactive Video Composition skill?
skills CLI (Claude Code, Cursor, Codex and more): npx skills add calesthio/generative-media-skills --skill audio-reactive-video-composition. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.
Is Audio Reactive Video Composition popular?
It lives in calesthio/generative-media-skills, which has 246 GitHub stars and 50 forks.
Related skills
2d Character Rig Animation
246calesthio/generative-media-skills
Production guidance for reusable layered 2D character rigs in browser-rendered and video media. Use for SVG hierarchies, pivots and constraints, FK/IK planning, pose and facial libraries, acting, cycles, deterministic handoff, crop variants, and rig QA; not for character concept continuity, 3D armatures, or motion-capture solving.
3d Asset Production
246calesthio/generative-media-skills
Use this skill to turn generated, captured, scanned, or modeled 3D output into production-ready standalone assets for DCC, real-time engine, web, or interchange delivery. It covers requirements, topology repair, scale and axes, UVs, PBR baking, LODs, static and skeletal readiness, rig handoff, optimization, glTF/USD/FBX delivery, validation, QA, and rights/provenance. Do not use it for provider-specific generation prompts, full scene/world building, mocap operation, or exact CAD/manufacturing work.
Ace Step
246calesthio/generative-media-skills
Use ACE-Step and ACE-Step 1.5 for local or hosted AI music generation, including text-to-music, lyrics-to-song, instrumental beds, covers, repainting, stem/track extraction, track completion, LoRA personalization, REST/Python/Gradio workflows, rights review, and music integration for video, ads, games, and social content.
Audiobook Production
246calesthio/generative-media-skills
Produce full-length audiobooks and long-form narration with generative voice tools. Use when the task is to turn a manuscript or long text into hours of spoken audio: preparing the manuscript for narration (front/back matter, footnotes, tables, dialogue), casting a single narrator or full cast, controlling pronunciation and voice consistency across a whole book, running a proofing/QC listen, meeting a retailer's technical delivery specs (RMS, peak, noise floor, room tone, chapterized files, metadata), and choosing a distribution route under each platform's current AI-narration policy. Not for
Audio Mixing Mastering
246calesthio/generative-media-skills
Provider-independent audio mixing and mastering direction for AI agents finishing generated videos, ads, trailers, explainers, podcasts, recuts, avatar clips, music videos, documentaries, and social content. Use when planning, mixing, repairing, mastering, QCing, or delivering dialogue, music, ambience, and sound effects, including loudness/true-peak targets, intelligibility, accessibility, stems, stereo/immersive decisions, platform/client specs, and final audio QA.
Audioshake Stem Separation
246calesthio/generative-media-skills
Operate AudioShake's cloud source-separation service (developer.audioshake.ai) to split a recording into stems. Use when a task involves isolating vocals, drums, bass, guitar, piano, keys, strings, or winds from music; separating dialogue / music / effects (DME) for film-TV post-production, localization, and dubbing; splitting a mixed recording into one stem per speaker; lyric transcription or word-level alignment; music detection/identification; or speech denoise/dereverb. Covers the Tasks API job lifecycle (assets, targets, formats, polling vs webhooks, credits, limits), choosing which stem
Browse the most popular Claude skills, all images, video & audio skills, or write your own with the skills generator.