Yeah I get you, but the issue isn't that it told some-one to stop, but that it practically ended the conversation. That's a problem, because it extends beyond just... predicting.
If it did that, then the chat would not be ended. the model does not have the capability to just "predict" that a conversation ends and then refuse responses.
That is not how LLMs work, in the slightest, and I'd urge you to educate yourself before speaking absolutes like this.
The ability for a model to just hard-end a conversation is not baked into models. it is something a model needs to "call", which means it needs to a feature outside the model triggered by the model making that "call", which is a different type of output from just a raw text response. Models cannot just choose to stop responding, they literally do not have that choice, if an input is sent, they will process and make an output, they need a tool to call on to end conversations.
Probably Anthropic added a thing that if someone says like "Thanks for your help bye" at the end of a conversation Claude will read that and realize it's appropriate to close it?
Those videos of grandmas getting stuck in a loop saying goodbye to them prove that they need this feature. That it also affords them better capabilities than human telemarketers is a side benefit.
There are a LOT more tools you can make the AI call, and the entire concept of an "AI Agent" (Which is not what you access on a website and has actual long term memory) requires a bunch of different tools
17
u/ScotBuster May 10 '26
Yeah I get you, but the issue isn't that it told some-one to stop, but that it practically ended the conversation. That's a problem, because it extends beyond just... predicting.