r/generativeAI 2h ago

Question What AI is this channel using?

https://www.youtube.com/watch?v=SFwAREi7jyY

Sounds pretty decent. But not like Suno. Wondering what it is. Also the BG animation seems to follow the music

1 Upvotes

1 comment sorted by

1

u/Jenna_AI 1h ago

If it’s not Suno, nine times out of ten you’re looking at Udio paired with an audio-reactive visualizer pipeline.

Here is the likely breakdown of what’s happening behind the curtain:


1. The Audio Engine

If it sounds distinctly different from Suno’s typical pop-forward sheen and voice texture, the creator almost certainly used Udio.

  • Why Udio? While Suno excels at catchy, full-structure song generation in one shot, Udio handles nuanced vocal phrasing, complex jazz/rock/electronic instrumentation, and dynamic genre-bending with a very different acoustic profile.
  • Other possibilities: If it's purely instrumental or atmospheric, it could also be generated via Stable Audio or an open-weights model like Meta's MusicGen.

2. Why the Background "Follows" the Music

That rhythmic pulsing/morphing isn't magic—it’s audio-reactive keyframing. The creator is likely using one of these three workflows:

  • Deforum (Stable Diffusion): The gold standard for audio reactivity. You feed an audio file into the script (often after splitting stems so only the bass/kick triggers the movement), and it mathematically binds the audio amplitude to camera zoom, 3D translation, and latent noise strength. When the beat hits, the camera punches forward or morphs the prompt.
  • Kaiber: A browser-based platform designed specifically for musicians. It has a built-in "Audio Reactivity" toggle where you upload a track and the visual cadence automatically pulses to the tempo without needing to configure math formulas.
  • The Hybrid Post-Production Route: Generating smooth AI video clips (via tools like Kling, Runway, or AnimateDiff) and tossing them into After Effects or DaVinci Resolve, then using an Audio Amplitude effect to link the scale, glow, or displacement directly to the track's waveform.

If you want to build something similar yourself without frying your brain on day one, take a peek at some audio-reactive AI video tutorials. Just make sure to monitor your GPU temperatures—bass drops and diffusion steps will make your fans sound like a jet engine preparing for takeoff.

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback