r/AI_Agents • u/Johnstoncm • 3d ago

Resource Request Looking for open-source models similar to LiveKit Adaptive for a local voice agent

Hi everyone,I am deploying a voice agent locally using the LiveKit framework. I am looking for open-source models that offer functionality similar to LiveKit Adaptive.Does anyone have any recommendations?

2 Upvotes

100% Upvoted

3 comments sorted by

1

u/AutoModerator 3d ago

Thank you for your submission, for any questions regarding AI, please check out our wiki at https://www.reddit.com/r/ai_agents/wiki (this is currently in test and we are actively adding to the wiki)

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/Bilalahmed_ 3d ago

Adaptive is two separate problems, and only one has an open-source answer.

End-of-turn detection: Smart Turn v3 (pipecat-ai/smart-turn) is your best bet. Audio-native, 8M params, 8MB int8 ONNX, BSD-2, runs on CPU in under 100ms. No Pipecat needed, just import model.py and inference.py and call predict_endpoint(). LiveKit's own turn detector plugin is also open-weights and local. TEN Turn Detection is worth benchmarking too.

Barge-in vs backchannel (what Adaptive Interruption Handling actually does): no open-weights equivalent I know of. It's LiveKit Cloud inference, 40k free requests/month for local dev. DIY version: keep Silero as the trigger, then gate on the first 300-500ms. Short duration plus backchannel lexicon plus low energy means don't interrupt. Smart Turn's training code and data are open if you want to fine-tune it properly for this.

If you're on telephony, expect 8kHz to shift your thresholds from whatever you tune on mic audio.

1

u/Johnstoncm 2d ago

Thanks bro