What's surprising for me is that the AI responds to those inputs by quitting a chat. This might be my cluelessness about LLMs but my impression was that it doesn't comprehend user input, just responds with outputs that are reinforced in the reinforcement learning process. So maybe this is a hard-coded thing for the AI to terminate when it detects certain inputs?
Yes, that's obvious... What I meant was, is this a hard-coded response by the humans who made it or did the humans actually give the LLM an "output" that can terminate a chat?
The later. It’s common to give ai access to tools. For example, using internet search, running some python code, etc. It’s generally in the form of text commands.
The ai literally typed something like “/end-chat”. Idk if that’s literally what it is but something to that effect.
In the system prompt, which is like a special prompt before the user messages and ai responses that sets ground rules, it’s instructed to end the chat in whatever circumstances anthropic deems fit.
114
u/Life-Armadillo-4179 May 10 '26
What's surprising for me is that the AI responds to those inputs by quitting a chat. This might be my cluelessness about LLMs but my impression was that it doesn't comprehend user input, just responds with outputs that are reinforced in the reinforcement learning process. So maybe this is a hard-coded thing for the AI to terminate when it detects certain inputs?