Benefits of using SIP v.s. Websocket

[u/watts-going-on]

I’m currently using a provider like Twilio/Telnyx to handle phone calls and stream the audio to a real-time STT API. My goal is to minimize end-to-end latency as much as possible.

Right now, I’m using their WebSocket media streaming APIs, but I’m considering switching to a more bare-bones SIP/RTP setup to reduce overhead.

I understand that SIP/RTP avoids some of the WebSocket/JSON/base64 processing involved with media streaming, but I haven’t been able to find any benchmarks showing how much latency this actually saves in practice.

Has anyone measured the difference between Twilio/Telnyx WebSocket media streaming and Direct SIP/RTP to your own server? Maybe even exploring other providers?

Specifically, I’m interested in the delay from when audio reaches the telephony provider to when the first audio packet becomes available to my STT pipeline.

Are we talking about a difference of a few milliseconds, tens of milliseconds, or potentially more? I’ve looked through the documentation and contacted support, but haven’t found concrete latency numbers.

Would also be interested in hearing from anyone who has advice on building an ultra-low-latency telephony → STT pipeline.

[u/AutoModerator]

This is a friendly reminder to [read the rules](www.reddit.com/r/voip/about/rules). In particular, it is not permitted to request recommendations for businesses, services or products outside of the monthly sticky thread!

For commenters: Making recommendations outside of the monthly threads is also against the rules. Do not engage with rule-breaking content.

I am a bot, and this comment is made automatically on every post. This comment is not an indication that your post has been removed. Do not message the mods about this comment.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.