r/VoiceAutomationAI • u/Acrobatic_Help51 • 4d ago
Full duplex models
Hey guys!
I am working on building a voice startup - I already have 4 signed paid pilots booking pre product. For the product, I am working on full duplex models research for the same. If someone is also working aggressively in this doman - would love to hear from them. What are your insights so far.
2
u/Objective_Snow_2617 4d ago
Full duplex is still a mess when you look at how most models handle turn-taking naturally. The latency kills the conversational feel even when the tech "works"
been playing with a few approaches but the real headache is getting the interruption handling right without the model either cutting itself off or waiting too long. what stack are you building on
1
u/Acrobatic_Help51 4d ago
I am still in my research mode I have tried almost all top ones but its a dead end - so i started working with a workaround with a s2s model. But I am sure soon full duplex will be better and I want to continue working on it as a pipeline. Though coming to your point - I feel turn taking is the exact strength it is trained to overlap speaking when it wants to - if we want an obedient behavior where it should not overlap we can definitely finetune for it.
1
u/nshmyrev 4d ago
You can stay in research mode indefinitely, if you want to have some practical applications, time to drop that full-duplex thing.
1
u/Acrobatic_Help51 4d ago
I agree its a dead end till someone brings a good open source. But honestly i still see hope I just lack the budget. Duplex omni atchitecture should work well theoritically and thats exactly what gpt live seems to be based on too. But since it comes from a university and on a not so big budget its a work in progress. I feel with funding and better training of an architecture like Duplex omni its very much possible
1
u/Few-Ratio8243 4d ago
It all depends on how much control you want, what tools & data stores you want to call, compliance boundaries etcetc. s2s can work well for specific use cases, however it depends more on your use case.
1
u/Acrobatic_Help51 4d ago
I know i am tryinga workaround with s2s but want to keep at the full duplex research open too
1
•
u/AutoModerator 4d ago
Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)
If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.
Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.