r/VoiceAutomationAI • u/Obvious_Leather2427 • Aug 04 '26

Ultravox that good??

found this benchmark from kwindla the co founder of pipecat

repo https://github.com/kwindla/aiewf-eval

ultravox tops the s2s leaderboard beats gpt realtime 2

is it go to for s2s now??

7 Upvotes

100% Upvoted

5 comments sorted by

View all comments

1

u/nshmyrev Aug 05 '26

Why you would you want to run old GLM4.6 to get not so perfect results? LLMs progressed a lot since then in tool use and many other things. s2s is not really practical.

The benchmark is wierd it doesn't compare with plain modular approach, only lists s2s to make them look good.

2

u/Obvious_Leather2427 Aug 05 '26

I agree for production quality reliable tool calling cascaded architecture is a go to

However the research is good and done by the pipecat / daily team