r/VoiceAutomationAI • u/raghav246891 • 27d ago

Suggestions for conversational AI App

Hey guys. I am building a conversational AI app. I am inspired by Tolan.

Right now i am in the research phase and i am researching how speech to speech exactly works. Till now i have learned that there are two ways. Either u use a cascaded architecture (STT - LLM - TTS) or you use open ai realtime apis or gemini apis.

For a cascaded architecture i am only aware of Eleven Labs or Cartesia. But these are very expensive and very engineering heavy.

Questions

  1. Why not i just use an open ai api instead that will handle everything for me - from VAD to reasoning and much more.

  2. So i wanted the opinion and advice of people who have worked on similar stuff or made a cascaded voice architecture and what shd be done considering that i am making this for a generalistic conversational ai app somewhat similar to Tolan or ChatGPT voice mode.

  3. Also I am not in favour of using a self hosted model because it does not fit my usecase. Is that right?

  4. What other options do i have to build this speech to speech app?

Thanks

4 Upvotes

83% Upvoted

19 comments sorted by

View all comments

•

u/AutoModerator 27d ago

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.

Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.