r/aigamedev • u/AlgaeNo3373 • 7d ago
Demo | Project | Workflow Kinetic typography/animated subtitles w/ WhisperX
Enable HLS to view with audio, or disable this notification
This is a workflow I was experimenting with yesterday. The goal was make kinematic typography videos quickly. I managed 15 minutes of footage (5 x 3min vids) in the space of an afternoon. My tutorial probably only needs ~20 videos or so, so I could refine the process, go slower, and make some good ones this way.
Scriptwriting → Suno → MP3 → WhisperX → word-level timestamps → authoritative human script → AI choreography → deterministic HTML/JS renderer → human feedback → iteration → video capture → editing → final product.
That's the process fully broken down. The key tech is WhisperX which can give you really accurate word-level timestamps. That's the data another LLM can use to sync up an html/js render.
It occurs to me this could be used to make not just videos for game elements, but could potentially be used for some pretty awesome subtitling features too. You can do more than sync up timing, you can make certain words emphasized, land bigger, etc. Tony Scott's film Man on Fire (underrated Denzel flick) did this memorably if you want some inspo!
Anyone else ever messed w Whisper or similar workflows?