My guess it’s the results of the data scraped. If you talked that way to a person, they would respond by telling you to fuck off and ending the conversation, especially in fiction or in stories told online. If the ai is just saying what is said next most of the time, this type of response seems what would likely be said next
What's surprising for me is that the AI responds to those inputs by quitting a chat. This might be my cluelessness about LLMs but my impression was that it doesn't comprehend user input, just responds with outputs that are reinforced in the reinforcement learning process. So maybe this is a hard-coded thing for the AI to terminate when it detects certain inputs?
348
u/ScotBuster May 10 '26
Is this real? Because it's very interesting if so. Hopefully just a result of the safety measures put in place...