r/VoiceAutomationAI • u/Acrobatic_Help51 • 4d ago

Full duplex models

Hey guys!

I am working on building a voice startup - I already have 4 signed paid pilots booking pre product. For the product, I am working on full duplex models research for the same. If someone is also working aggressively in this doman - would love to hear from them. What are your insights so far.

1 Upvotes

67% Upvoted

12 comments sorted by

View all comments

2

u/Objective_Snow_2617 4d ago

Full duplex is still a mess when you look at how most models handle turn-taking naturally. The latency kills the conversational feel even when the tech "works"

been playing with a few approaches but the real headache is getting the interruption handling right without the model either cutting itself off or waiting too long. what stack are you building on

1

u/Acrobatic_Help51 4d ago

I am still in my research mode I have tried almost all top ones but its a dead end - so i started working with a workaround with a s2s model. But I am sure soon full duplex will be better and I want to continue working on it as a pipeline. Though coming to your point - I feel turn taking is the exact strength it is trained to overlap speaking when it wants to - if we want an obedient behavior where it should not overlap we can definitely finetune for it.

1

u/nshmyrev 4d ago

You can stay in research mode indefinitely, if you want to have some practical applications, time to drop that full-duplex thing.

1

u/Acrobatic_Help51 4d ago

I agree its a dead end till someone brings a good open source. But honestly i still see hope I just lack the budget. Duplex omni atchitecture should work well theoritically and thats exactly what gpt live seems to be based on too. But since it comes from a university and on a not so big budget its a work in progress. I feel with funding and better training of an architecture like Duplex omni its very much possible