VoiceFi Mark VoiceFi

The Generative
Social Reel Engine

How I built viral 2D pencil flipbook reels combining real human voice recordings, multi-agent banter, Faster-Whisper sub-10ms forced alignment, and glowing kinetic karaoke.

Open Developer Specification & Free Agent Skill

Get the Full Agent Skill & Python Engine Free

Enter your email to immediately unlock and copy the complete social-reel-producer Antigravity & Claude Code skill, full FFmpeg scripts, and Veo prompt formula.

The 4-Stage Production Pipeline

How VoiceFi compiles real voice recordings, neural speech, and 2D animations into zero-drift social reels.

Stage 01 · Acoustic Engine

Multi-Agent Soundstaging & Live Voice Ducking

Mixes real 48kHz microphone audio with neural speech personas (Ava, Steffan, Emily) over a procedural NumPy lo-fi chord bed. A rolling 100ms RMS energy detector ducks background music by 75% whenever dialogue is active.

master = dialogue * 0.90 + music * duck_envelope * 0.70
Stage 02 · Timing & Sync

Faster-Whisper Sub-10ms Forced Alignment

Extracts exact millisecond (word, start, end) timestamps with C++ Whisper. A gapless timeline builder sequences pre-speech silence, word spans, breath pauses, and outro holds to guarantee exact 0.0000s drift.

Pre-Speech + Σ(Word Spans + Breath Gaps) + Hold = Audio Dur
Stage 03 · Kinetic Typography

Headless Chrome Zero-Shift Overlay Engine

Renders 1080x1920 transparent PNG frames in parallel using Headless Chrome. The top speaker pill (top: 130px) and bottom caption card (bottom: 160px, h: 280px) use fixed coordinates and identical font metrics to prevent layout shifts.

.word-active { color: var(--tag); text-shadow: 0 0 24px var(--tag); }
Stage 04 · Video Compositing

Generative Canvas & FFmpeg Stream Muxing

Composites 2D pencil flipbook clips (Google Flow / Veo 12fps line boil) with transparent subtitle overlays. Uses tpad=stop_mode=clone to freeze completed sketch drawings without looping, and explicit -map 0:v:0 -map 1:a:0 for clean broadcast audio.

ffmpeg -i video.mp4 -i master.mp3 -map 0:v:0 -map 1:a:0 master.mp4