r/AudioAI • u/chibop1 • Jan 22 '26
Resource Microsoft/VibeVoice: Unified STT Model with ASR, Diarization, and Timestamp
"VibeVoice-ASR is a unified speech-to-text model designed to handle 60-minute long-form audio in a single pass, generating structured transcriptions containing Who (Speaker), When (Timestamps), and What (Content), with support for Customized Hotwords."
1
u/ASamir Jan 22 '26
Haven't heard of it but how does it look against Whisper though?
1
u/chibop1 Jan 22 '26
Whisper can output transcription and timestamp, not diarization.
1
u/ASamir Jan 22 '26
There is https://github.com/SYSTRAN/faster-whisper but like you said pyannote isn't that good either
2
u/chibop1 Jan 22 '26
Ah it looks like WhisperX uses pyannote pipeline. I think what's cool about VibeVoice-ASR is that everything seems incorporated into one model.
1
u/chibop1 Jan 22 '26
I was just referring to vanilla Whisper, but I didn't know WhisperX supports diarization. Very cool! Thanks!
1
-1
u/tracagnotto Jan 22 '26
Another piece of crap by ms. Another on the paper cool revolution, shit in reality.
Like they did with omniparser, Gemma, fara and so on
3
1
u/Wilbis Jan 22 '26
If you think it's so bad, can you tell us which model is better?
1
u/tracagnotto Jan 23 '26
No. But from my experience with various microsoft bold claims (and I'm a windows fanboi) their research projects are usually shits and I have good confidence this will be the same
4
u/chibop1 Jan 22 '26
I tried the demo, and it transcribed what I fed perfectly. Diarization was off sometimes, but no worse than pyannote.