Audio Reactive Video Composition

Provider-independent production guidance for translating measured audio features into deterministic video timing and motion. Use for beat-, onset-, phrase-, energy-, silence-, or spectrum-reactive visualizers, edits, typography, and generated compositions; not for music-video concept direction, audio generation, or a runtime-specific recipe.

246 stars 50 forksImages, Video & Audio

Install

skills CLI (Claude Code, Cursor, Codex and more)
npx skills add calesthio/generative-media-skills --skill audio-reactive-video-composition
Manual install
git clone --depth 1 https://github.com/calesthio/generative-media-skills.git /tmp/generative-media-skills
mkdir -p ~/.claude/skills
cp -r /tmp/generative-media-skills/skills/production/runtime-assembly/audio-reactive-video-composition ~/.claude/skills/audio-reactive-video-composition

Personal skills live in ~/.claude/skills. Use .claude/skills in a project folder to share a skill with your team.

From the SKILL.md

# Audio-reactive video composition

Use this skill to turn an approved audio source into an auditable cue map and then into bounded visual behavior. The central contract is:

$$
\text{source audio} \rightarrow \text{measured features} \rightarrow
\text{confidence-bearing cues} \rightarrow \text{reviewed anchors} \rightarrow
\text{deterministic visual timeline}
$$

Do not equate a detector output with editorial meaning. An onset is not automatically a beat, cut, drop, or lyric accent; an acoustic cluster is not automatically a verse or chorus.

## Evidence stance

- **Documented fact:** behavior stated by official analysis libraries, standards, or cited research.
- **Production heuristic:** a practical mapping that must be tested on the track and audience.
- **Empirical observation:** a measured result from the supplied audio, analyzer run, render, or playback.

Analysis algorithms, defaults, and model behavior are volatile. Facts were verified **2026-07-12**. Pin the decoder, library, model, parameters, and random seeds used for each production.

## Scope

This skill owns source custody, analysis policy, confidence interpretation, rhythmic/non-rhythmic routing, cue promotion, feature-to-visual mappings, rational frame alignment, accessibility, and render QA.

It does not own music-video narrative or artist branding, music generation, mastering, source separation, transcription, lyric writing, or a HyperFrames/Remotion/FFmpeg-specific implementation.
Read the full skill on GitHub

Details

Skill name
audio-reactive-video-composition
Path
skills/production/runtime-assembly/audio-reactive-video-composition/SKILL.md
License
MIT
Repo updated
14 July 2026

FAQ

What does the Audio Reactive Video Composition skill do?

Provider-independent production guidance for translating measured audio features into deterministic video timing and motion. Use for beat-, onset-, phrase-, energy-, silence-, or spectrum-reactive visualizers, edits, typography, and generated compositions; not for music-video concept direction, audio generation, or a runtime-specific recipe.

How do I install the Audio Reactive Video Composition skill?

skills CLI (Claude Code, Cursor, Codex and more): npx skills add calesthio/generative-media-skills --skill audio-reactive-video-composition. Skills go in ~/.claude/skills (personal) or .claude/skills (project), and Claude loads them automatically when a task matches the description.

Is Audio Reactive Video Composition popular?

It lives in calesthio/generative-media-skills, which has 246 GitHub stars and 50 forks.

Related skills

2d Character Rig Animation

246

calesthio/generative-media-skills

Production guidance for reusable layered 2D character rigs in browser-rendered and video media. Use for SVG hierarchies, pivots and constraints, FK/IK planning, pose and facial libraries, acting, cycles, deterministic handoff, crop variants, and rig QA; not for character concept continuity, 3D armatures, or motion-capture solving.

Frontend & Design50

3d Asset Production

246

calesthio/generative-media-skills

Use this skill to turn generated, captured, scanned, or modeled 3D output into production-ready standalone assets for DCC, real-time engine, web, or interchange delivery. It covers requirements, topology repair, scale and axes, UVs, PBR baking, LODs, static and skeletal readiness, rig handoff, optimization, glTF/USD/FBX delivery, validation, QA, and rights/provenance. Do not use it for provider-specific generation prompts, full scene/world building, mocap operation, or exact CAD/manufacturing work.

Images, Video & Audio50

Ace Step

246

calesthio/generative-media-skills

Use ACE-Step and ACE-Step 1.5 for local or hosted AI music generation, including text-to-music, lyrics-to-song, instrumental beds, covers, repainting, stem/track extraction, track completion, LoRA personalization, REST/Python/Gradio workflows, rights review, and music integration for video, ads, games, and social content.

Images, Video & Audio50

Audiobook Production

246

calesthio/generative-media-skills

Produce full-length audiobooks and long-form narration with generative voice tools. Use when the task is to turn a manuscript or long text into hours of spoken audio: preparing the manuscript for narration (front/back matter, footnotes, tables, dialogue), casting a single narrator or full cast, controlling pronunciation and voice consistency across a whole book, running a proofing/QC listen, meeting a retailer's technical delivery specs (RMS, peak, noise floor, room tone, chapterized files, metadata), and choosing a distribution route under each platform's current AI-narration policy. Not for

Images, Video & Audio50

Audio Mixing Mastering

246

calesthio/generative-media-skills

Provider-independent audio mixing and mastering direction for AI agents finishing generated videos, ads, trailers, explainers, podcasts, recuts, avatar clips, music videos, documentaries, and social content. Use when planning, mixing, repairing, mastering, QCing, or delivering dialogue, music, ambience, and sound effects, including loudness/true-peak targets, intelligibility, accessibility, stems, stereo/immersive decisions, platform/client specs, and final audio QA.

Images, Video & Audio50

Audioshake Stem Separation

246

calesthio/generative-media-skills

Operate AudioShake's cloud source-separation service (developer.audioshake.ai) to split a recording into stems. Use when a task involves isolating vocals, drums, bass, guitar, piano, keys, strings, or winds from music; separating dialogue / music / effects (DME) for film-TV post-production, localization, and dubbing; splitting a mixed recording into one stem per speaker; lyric transcription or word-level alignment; music detection/identification; or speech denoise/dereverb. Covers the Tasks API job lifecycle (assets, targets, formats, polling vs webhooks, credits, limits), choosing which stem

Images, Video & Audio50

Browse the most popular Claude skills, all images, video & audio skills, or write your own with the skills generator.