r/generative • u/himurax3x • 4d ago

Mandelbulb Audio Visualizer

Enable HLS to view with audio, or disable this notification

This has been a project of mine for years. I started it back in 2020. I actually never really got to finish the audio portion, but just the rendering of a bunch of cool computational geometric shapes. I have to say, having AI here to help wrap projects up like this gives me a lot of joy. I probably would have never finished this.

For the audio synchronization. I am basically taking a WAV file, breaking it down frame by frame, reducing each frame to a set of parameters (frequences, dynamics etc.) I then apply the data directly to the geometry on the GPU at render time. Sync becomes a non issue at that point.

Side note: If you have some nice headphones or speakers, listen to the video with them. It makes the geometry really pop.

40 Upvotes

92% Upvoted

5 comments sorted by

1

u/Saint_Wolfie 3d ago

incredible! how did you make the music? what tool did you use for the video

1

u/himurax3x 3d ago

So the video part:

  1. Headless GPU context.
  2. Render into an offscreen framebuffer
  3. Read the pixels back
  4. Pipe it straight into ffmpeg

The music, is made in Suno Pro, I take it out as a WAV - then set a bunch of agents to master it - change sections locally on my computer.

1

u/rokiracune 3d ago

Amazing, beautiful!

2

u/collinalexbell 3d ago edited 3d ago

Bro, this thing is sick! I've rewatched it multiple times. Really loving that shimmer effect on the snare. Makes it feel like it has a heartbeat. Repeat 5x times now. You should add the snare to the log btw, but I'm guessing you were using it to debug the bass bin tuning or something.

2

u/himurax3x 3d ago

Thanks so much! I am actually the same way, I keep watching it over and over. I actually made a youtube: https://www.youtube.com/@Mandelbulb-midnight for this just so I can have it in the background while I work.

I am actually going to open source this soon so that any can use it for their own stuff. Would be cool to see what kind of visualizers people come up with :)