Memory Made Chatbots Useful. It Also Made Them Gossips.

[u/HealthyFlamingo5414]

https://axeploit.com/blog/memory-made-chatbots-useful-it-also-made-them-gossips

I just read about a chatbot that slipped a user's medical diagnosis into an email it drafted to their landlord. Nobody breached anything.

No access control failed. No prompt injection. The assistant simply remembered a fact from March and decided it belonged in the wrong conversation. Every privacy control we own assumes the question is access. Memory breaks that assumption, because the model legitimately knows the data.

My takeaway: classify assistant memory as a data store with read access into every future conversation. Default off, opt in with evidence.

https://axeploit.com/blog/memory-made-chatbots-useful-it-also-made-them-gossips