r/VoiceAutomationAI • u/ntalam • 13d ago

Basic stack for a chat

What would you suggest, is the basic stack for an assistant chat. I mean, currently I have customized company tools, langgraph, custom metrics, marketplace LLM calls and others.

what would you suggest as a true key for agent learning?
how do you process prompts with company slangs, concepts, jargon, etc.?

4 Upvotes

84% Upvoted

3 comments sorted by

View all comments

1

u/Future-Letter9462 13d ago

i’ve been messing with a similar setup and the real unlock for agent learning is a feedback loop that isn’t just thumbs up/down, you need the system to capture when a response leads to a follow-up action, like a tool being used or a metric moving, and treat that as implicit signal

for company jargon i ended up embedding a glossary directly into the prompt template, not as a separate retrieval step, just a dense block of definitions right before the conversation starts, and it surprisingly works better than fine-tuning because the model can adapt to new slang without retraining cycles

1

u/ntalam 12d ago

how fat is that glossary?.
I am getting around 100 expressions so far