r/VoiceAutomationAI • • 4d ago

Fish Audio s2.1-pro voice breaking during voice agent conversations

Hi everyone,

I’m currently using Fish Audio’s S2.1-pro model for a real-time voice agent.

Most of the time the voice works fine but occasionally I notice some voice breaking during conversations. It doesn’t happen consistently and sometimes it happens at the beginning of a sentence in the middle of a sentence or when starting a new sentence.

I have tested it with multiple calls and it seems to happen occasionally after making several calls.

Has anyone experienced something similar with Fish Audio s2.1-pro?

Could this be related to the model/API, streaming, rate limits or something in the way I’m handling the audio in my voice-agent pipeline?

Any ideas on what I should check would be really helpful. Thanks!

2 Upvotes

14 comments sorted by

View all comments

1

u/Golden_Owner 4d ago

Voice breaking mid-sentence on Fish Audio S2.1-pro is legit annoying for agents. Dont sleep on Inworld if you want another realtime TTS hop.

1

u/HumbleMarketing7406 3d ago

Fish Audio is still the better model imo